-- Logs begin at Mon 2022-07-25 21:54:48 UTC, end at Mon 2022-07-25 23:05:48 UTC. -- Jul 25 22:38:18.580736 dv-osbrick-849020-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 22:38:18.587973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 22:38:18 2022] *** Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: nodename: dv-osbrick-849020-3-iscsi Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: machine: x86_64 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: clock source: unix Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: pcre jit disabled Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: detected number of CPU cores: 4 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: current working directory: / Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: detected binary path: /usr/bin/uwsgi-core Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: your processes number limit is 47680 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: your memory page size is 4096 bytes Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: detected max file descriptor number: 2048 Jul 25 22:38:18.591403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: lock engine: pthread robust mutexes Jul 25 22:38:18.592133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: thunder lock: enabled Jul 25 22:38:18.592133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 22:38:18.592133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 22:38:18.632162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: Python main interpreter initialized at 0x55f91f2dc9c0 Jul 25 22:38:18.632162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: python threads support enabled Jul 25 22:38:18.632162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: your server socket listen backlog is limited to 100 connections Jul 25 22:38:18.632162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: your mercy for graceful operations on workers is 90 seconds Jul 25 22:38:18.632551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 22:38:18.632633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: *** Operational MODE: preforking *** Jul 25 22:38:18.632892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: *** uWSGI is running in multiple interpreter mode *** Jul 25 22:38:18.632892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: spawned uWSGI master process (pid: 87021) Jul 25 22:38:18.633090 dv-osbrick-849020-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 25 22:38:18.634320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: spawned uWSGI worker 1 (pid: 87030, cores: 1) Jul 25 22:38:18.634320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: spawned uWSGI worker 2 (pid: 87031, cores: 1) Jul 25 22:38:18.634320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87021]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 22:38:24.196597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:38:24.196597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: from cryptography.utils import int_from_bytes Jul 25 22:38:24.197415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:38:24.197415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: from cryptography.utils import int_from_bytes Jul 25 22:38:24.247739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:38:24.247943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:38:24.248139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] command line args: [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:38:24.248449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:38:24.248631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ================================================================================ {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:38:24.248899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] admin_token = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.249153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] config_dir = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.249343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.249530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] config_source = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.249712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] debug = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.249912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.250277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.250462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.250721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.250975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.251211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.251393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_config_append = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.251573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.251753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_dir = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.251933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_file = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.252176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.252438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:38:24.252438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: from cryptography.utils import int_from_bytes Jul 25 22:38:24.252923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.252923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.253041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:38:24.253041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: from cryptography.utils import int_from_bytes Jul 25 22:38:24.253138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.253138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.253312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.253565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.253812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.254052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.254293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.254530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.254766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.255016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.255268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.255548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.256054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.256243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] publish_errors = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.256515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.256754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.256937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.257191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.257436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.257684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] standard_threads = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.257922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.258171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.258352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.258533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] use_journal = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.258713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] use_json = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.258892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] use_stderr = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.259070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] use_syslog = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.259308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.259568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.259813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.260077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.260339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.260597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.260844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.261096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.261335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.261588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.261841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.262094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.262333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.262585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.262825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.263077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.263326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.263569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.263828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.264086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.264358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.264600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.264857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.265122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.265381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.265635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.265872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.266108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.266344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.266584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.266837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.267091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.267327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.267570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.267822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.268075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.268873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.269129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.269368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.269609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.269849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.270084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.270319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.270554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.270791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.271033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.271286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.271524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.271767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.272003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.272244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.272510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.272763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.273000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.273243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.273486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.273729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.273970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.274211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.274446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.274707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.274944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.275377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.275617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.275884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.276128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.276390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.276636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.276879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.277155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.277403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.277658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.277908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.278155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.278396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.278637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.278890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.279136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.279378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.279627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.279871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.280115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.280378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.280622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.280864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.281131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.281375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.281619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.281862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.282109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.282351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.282592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.282834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.283062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.283294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.283526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.283762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.284669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.284922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.285167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.285424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.285671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.285935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.286201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.286449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.286690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.external = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.286929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.287232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.287471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.287709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.password = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.287947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] auth.token = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.288199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.288465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.288718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.288957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.289211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.289466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.289705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.289945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.290199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.290454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.290706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.290950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.291204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.291444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.291720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.291981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.292222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.292507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.292798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.293052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.293322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.293572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.293835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.294076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.294321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.294574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.294828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.295064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.295317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.295560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.295938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.296068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.296327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.296575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.296843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.297088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.297352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.297608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.297849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.298089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.298346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.298584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.298829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.299084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.299341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.299607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.299843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.300081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.300353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.300575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:38:24.300664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.300788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:38:24.300864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.300943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] command line args: [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:38:24.301095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.301201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:38:24.301349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.301427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ================================================================================ {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:38:24.301617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] admin_token = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.301704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.301859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.301936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] config_dir = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.302216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] config_source = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.302414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] debug = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.302798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.302874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.302973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.303056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.303222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.303300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.303469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.303546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.303700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.303778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.303876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_config_append = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.303952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.304050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.304199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.304316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_dir = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.304411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_file = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.304488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.304649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.304727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.304897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.304986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.305141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.305218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.305386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.305465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.305562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.305641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.305736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.305845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.305977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.306088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.306220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.306332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.306453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.306580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.306687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.306824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.306910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.307066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.307144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.307320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.307398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.307573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.307659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.307810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.307894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.308046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.308329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.308411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.308527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] publish_errors = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.308606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.308758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.308835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.308981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.309062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.309141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.309251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.309377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.309487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.309617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.309730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.309849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] standard_threads = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.309995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.310073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.310232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.310309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.310467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.310545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.310642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] use_journal = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.310719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.310815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] use_json = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.310954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] use_stderr = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.311146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] use_syslog = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.311227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:38:24.311451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.311939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.312934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.313970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.314954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.315951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.316943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.317924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.318988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.319952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.320923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] role.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] role.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.321854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.322941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.323958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.324840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.325856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.326961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.327983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.328979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.329925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.330705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.331881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.332855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.333953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.connection = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.334965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.335932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.336909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.external = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.337937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.password = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] auth.token = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.338975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87030) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:38:24.339053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.339267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.339514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.340026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.340264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.340523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.340770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.341019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.341267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.341503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.341748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.341982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.342242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.342494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.342730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.342980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.343258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.343505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.343764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.344009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.344263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.344521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.344758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.345009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.345253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.345483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.345728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.345963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.346216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.347027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.347291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.347527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.347775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.348010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.348257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.348527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.348764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.348999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.349246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.349477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.349714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.349961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.350215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.350559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.350797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.351029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.351272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.351517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.351763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.352016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.352260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.352551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.352790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.353027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.353257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.353495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.353724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.353956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.354194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.354430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.354676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.354905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.355150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.355396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.355630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.355875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.356119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.356373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.356613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.356842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.357079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.357315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.357553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.357789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.358024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.358270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.358516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.358745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.358974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.359220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.359466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.359700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.359934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.360173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.360431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.360669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.360939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.361171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.361417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.361662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.361906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.362187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.362418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.362652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.362888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.363123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.363353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.363597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.363841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.364085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.364350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.364596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.364824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.365069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.365316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.365553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.365789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.366024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.366268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.366512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.366750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.367002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.367231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.367473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.367711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.367944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.368310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.368628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.368872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.368950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.369104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.369184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.369333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.369415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.369569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.369819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.370066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.370305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.370552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.370801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.371035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.371280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.371515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.371751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.371983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] role.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.372228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] role.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.372484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.372731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.372978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.373222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.373465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.373709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.373953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.374196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.374439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.374669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.374913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.375155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.375398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.375641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.376035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.376270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.376544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.376791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.377036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.377282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.377516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.377760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.377841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.378108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.378355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.378592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.378821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.379053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.379305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.379557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.379845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.380042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.380352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.380535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.380768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.381006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.381251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.381486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.381739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.381984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.382219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.382463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.382703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.382949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.383185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.383422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.383666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.383912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.384158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.384411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.384655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.384955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.385215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.connection = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.385460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.385704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.385941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.386179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.386411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.386644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.386878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.387111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.387355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.387589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.387832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.388065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.388332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.388567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.388810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.389039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.389275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.389507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:38:24.389673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:38:24.407477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.407715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.414942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.415170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.415391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.423672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.443496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.443722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.461346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.481981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.512443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.512682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.519390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.519624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.577971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.578940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.579072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.579171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.579302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.579513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.603952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.604608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.615515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.616039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.628681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.628913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.629992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.630066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87030) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.630184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.630391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 22:38:24.647444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.647656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:38:24.647990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.648072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.648191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:38:24.648276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:38:24.648491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.648623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.648753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.648849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 22:38:24.649013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.649096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.649268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.649349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.649534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.649782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.659921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.660129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.660439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.666900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.667274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.671895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.671978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.672172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.672253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.672472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.672556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.672749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.672832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.673879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.674045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.674125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.674307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.674388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.674587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.698101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.698251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.699565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.699735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.699834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.700020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.704424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.704666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.704750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.704949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.705045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.705229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.712132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.712361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.712447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.712648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.717154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.717342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.717985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.718978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.719067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.734870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.734960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.735141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.735224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.739186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.739270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.742366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.742673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.742754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.742961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.747067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.747599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.750258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.750969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.753986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.754283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.754568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.754868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.754950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.755155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.755239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.755437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.755518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.755712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.756060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.756489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.771956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.772238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.772538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.772805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.773131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.773409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.773669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.773926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.779706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.780790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.781294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.781577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.782320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.782589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.784446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.784726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.785024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.785310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.785570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.785653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.785845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.786129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.786424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.786707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.797099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.797378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.797658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.797938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.798210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.798302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.798483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.798565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.798750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.798832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.799021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.799291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.800088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.800505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.815163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.817083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.818674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.820030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.821648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.822958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.824113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.825405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.825697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.825987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.826270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.826874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.827241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.827519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.832848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.833993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.834436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.835576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.837379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.837671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.837957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.838231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.838489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.838772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.839057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.839334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.846610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.846900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.847177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.847705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.847985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.848258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.854074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87030) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.854353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.854636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.854922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.855204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.855337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 22:38:24.855485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.855689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.855782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.855966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.856991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87030) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.857942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.858214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.858477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.858734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.858985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 22:38:24.892229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f91f2dc9c0 pid: 87030 (default app) Jul 25 22:38:24.893271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f91f2dc9c0 pid: 87031 (default app) Jul 25 22:38:24.895535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012577e-ee7f-4907-9803-13f996c906b1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:24.895829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012577e-ee7f-4907-9803-13f996c906b1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:24.896107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012577e-ee7f-4907-9803-13f996c906b1 None None] PATH_INFO: `/v3` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:24.900542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Mon Jul 25 22:38:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:32.413661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:32.414219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:32.414219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:32.418560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:38:32.423930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:32.424919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:32.425021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:32.496274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: INFO dbcounter [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] Registered counter for database keystone Jul 25 22:38:32.517914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG oslo_db.sqlalchemy.engines [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87030) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:38:32.524129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writer thread running {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:38:32.702732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG passlib.handlers.bcrypt [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87030) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:38:32.703065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG passlib.handlers.bcrypt [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87030) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:38:32.757902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:32.759525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:32.886755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 22:38:33.021127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:33.090443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: INFO dbcounter [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] Registered counter for database keystone Jul 25 22:38:33.109596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG oslo_db.sqlalchemy.engines [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:38:33.115709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writer thread running {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:38:33.234203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fe9e1-fa92-4434-b84a-b2b16ec2b0e4 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:33.241726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:33.242366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:33.242650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:33.242927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:33.251163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:33.303375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:38:33.303661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344fb66-ce32-4481-a633-b4f5fd455327 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:33.313231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Mon Jul 25 22:38:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:38:33.319785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:33.334188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1b4db-90cb-4cf0-bfc1-aaa0f8f65e44 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:33.338739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:33.340090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:33.340416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:33.340703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] PATH_INFO: `/v3/projects/bac6b86a78e2495dac480c2085c0033f` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:33.342181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] RBAC: Authorizing `identity:get_project(project_id=bac6b86a78e2495dac480c2085c0033f)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:33.392785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 22:38:33.393160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabdec0-7e2a-4261-8ddf-6881f492e34d admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:33.399986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Mon Jul 25 22:38:33 2022] GET /identity/v3/projects/bac6b86a78e2495dac480c2085c0033f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:35.376849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fae14-22a3-4da9-86cf-cff75f835b37 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:35.377356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fae14-22a3-4da9-86cf-cff75f835b37 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:35.377441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fae14-22a3-4da9-86cf-cff75f835b37 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:35.381597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:35.386780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:35.387160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:35.387333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:35.407803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:35.410028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:35.417812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 22:38:35.448159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fae14-22a3-4da9-86cf-cff75f835b37 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:35.460867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fae14-22a3-4da9-86cf-cff75f835b37 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:35.465311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:35.465922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:35.466205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:35.466488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:35.474872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:35.476697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76250c15-d467-4937-93f9-65f09579bd2a admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:35.485327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Mon Jul 25 22:38:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:38:35.490690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:35.499659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a535755-2ad7-40d0-9166-5198aaed3517 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:35.503919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:35.504594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:35.504878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:35.505155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:35.506502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:35.508327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcaeca-e8f5-496b-a4a9-891347974e7d admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:35.509864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Mon Jul 25 22:38:35 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:37.555818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a0c7f-3361-4252-bd43-14917fd21004 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.556357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a0c7f-3361-4252-bd43-14917fd21004 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.556357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a0c7f-3361-4252-bd43-14917fd21004 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.558575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:37.563552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.564000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.564087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.574757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a5b6b-65ff-436c-b196-c58cef563984 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.575039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a5b6b-65ff-436c-b196-c58cef563984 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.575321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a5b6b-65ff-436c-b196-c58cef563984 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.576687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:38:37.581702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.581989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.582270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.585367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:37.586587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:37.623665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG passlib.handlers.bcrypt [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87031) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 22:38:37.624082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG passlib.handlers.bcrypt [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87031) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 22:38:37.665949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:37.669417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:37.671019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:37.689136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:37.712637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:37.772803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:37.790468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e8d37-566a-4b8a-ac4f-3f8f2cede492 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:37.794137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:37.824795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:37.825382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.825664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.825944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.836963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:37.846201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:37.847152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:38:37.847995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:37.853241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:37.901061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290d4c5-e471-4945-9690-7c93d81f2af8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:37.903291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:37.936409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:37.939225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:37.940123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.940448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.940722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.953967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b857fa-8502-476f-b088-1d9f56eb617b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:37.988092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:37.988757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:37.989041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:37.989326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:37.990049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:37.990354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:37.991736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.003242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:38.008846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.008978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:38.010415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.107015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:38:38.109394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc39fe6-9820-414f-8cdc-5fbac1769ba0 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:38.113020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:38.115641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:38.217176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83885a19-1181-463e-879c-20cc4f07ffef None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:38.259994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:38.260240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:38.260681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:38.260887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:38.260982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:38.261177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:38.261312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:38.261447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:38.262395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.263835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.265462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:38 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:38.271304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:38.280721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.282207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.286265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:38.301971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:38.302881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:38.303673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:38.303673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:38.303673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:38.303673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:38.303673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:38.309944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:38.365656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:38.375466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3f31-c5a3-40a4-b60b-a7ecb5605679 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:38.409983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:38.410633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:38.410746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2765912e-f49d-41ca-92b7-6e8a5bde53e5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:38.410914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:38.411188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:38.412372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.413812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.415396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:38.421455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:38.445435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:38.446056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:38.446335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:38.446613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:38.447308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:38.447611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.449024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94690e5a-a350-419b-862d-818da4c8ff48 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.466231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:38.503728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:38.525672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c25e0-0784-40cc-a241-a2e488f251b9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:38.561410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:38.562048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:38.562332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:38.562608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:38.563413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.domain.id=default, user.id=f76f4c331aa04a1a86326998b6795006) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:38.563724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:38.565877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a0cc5-0c93-4092-b89d-52739d8f2538 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:38.573370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Mon Jul 25 22:38:38 2022] GET /identity/v3/role_assignments?user.id=f76f4c331aa04a1a86326998b6795006&scope.domain.id=default&role.id=e3f77a14908d48e99043f557a465098a => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:40.808687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3607-8f19-47d6-9533-4ba1f2f09eba None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:40.809207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3607-8f19-47d6-9533-4ba1f2f09eba None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:40.809280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3607-8f19-47d6-9533-4ba1f2f09eba None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:40.810840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:40.822738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463a8c-c740-48b8-84c7-51fea0704bd4 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:40.823271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463a8c-c740-48b8-84c7-51fea0704bd4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:40.823271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7463a8c-c740-48b8-84c7-51fea0704bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:40.845075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a7463a8c-c740-48b8-84c7-51fea0704bd4 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:40.847182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a7463a8c-c740-48b8-84c7-51fea0704bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:40.936722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:40.977787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3607-8f19-47d6-9533-4ba1f2f09eba None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:41.108059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3607-8f19-47d6-9533-4ba1f2f09eba None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:41.144639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:41.165142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:41.165788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.166063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.166332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.188049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:41.190090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:41.192560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f32b-59a8-4760-b2a0-01f2c855d6f8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.193218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f32b-59a8-4760-b2a0-01f2c855d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.193702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5f32b-59a8-4760-b2a0-01f2c855d6f8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.195273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:38:41.200646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba87-3226-4e6e-9ded-b0be5c76e932 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.201183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba87-3226-4e6e-9ded-b0be5c76e932 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.201655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ba87-3226-4e6e-9ded-b0be5c76e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:38:41.213583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:41.214753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:41.215533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:38:41.215533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:38:41.215533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:38:41.215533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:41.215533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 12/25] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:41.222493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:41.224765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6690ba87-3226-4e6e-9ded-b0be5c76e932 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:41.226167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6690ba87-3226-4e6e-9ded-b0be5c76e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:41.325441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:41.332209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c06a8-ee10-461b-829b-7d8e0bf46d29 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.332778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c06a8-ee10-461b-829b-7d8e0bf46d29 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.333386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526c06a8-ee10-461b-829b-7d8e0bf46d29 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.335373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 15/27] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:41.348997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.349563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.350168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.367461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:41.382003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:41.383911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:41.419345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fa8f9-0ed7-432b-bdfa-8c5a0941ca23 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:41.480457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 16/28] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:41.481430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:41.491029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:41.491681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.491970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.492254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.493071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:41.493382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:41.494819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:41.521361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 13/29] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:41.522216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:41.621829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62884c-19bb-47c6-831b-9241037875ae None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:41.661473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:41.662115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.662400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.662680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.663834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:41.665609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429714f-f043-4fea-a5dc-0317a8dc8c07 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:41.670257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:41.674936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:41.754811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f5aa0-923c-469d-b592-23d3cc800dbc None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:41.790568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:41.791255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.791540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.791821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.792569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:41.793992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4719a-2407-4f87-8011-7d3525809e96 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:41.816983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 17/30] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/roles => generated 225 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:41.818634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768b74-5a97-4b48-821a-1d3311bace7f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.819027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768b74-5a97-4b48-821a-1d3311bace7f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.819409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56768b74-5a97-4b48-821a-1d3311bace7f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.820792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 18/31] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:41.821591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56768b74-5a97-4b48-821a-1d3311bace7f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:41.937673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56768b74-5a97-4b48-821a-1d3311bace7f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:41.964900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 14/32] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/roles => generated 219 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:41.966941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.967236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.967617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.976950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:41.977801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:41.978132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:41.978517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:41.979326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:41.981175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7547626-c54b-4b3a-866d-49a5872e1f74 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.006038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:42.007983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:42.024789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 19/33] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:42.027356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183491c6-49b7-4fc3-b6c1-84d450b13784 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.027657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183491c6-49b7-4fc3-b6c1-84d450b13784 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.029457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183491c6-49b7-4fc3-b6c1-84d450b13784 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.031825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 20/34] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:42.042111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.042415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.042669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.063870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:42.065682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:42.122405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.151513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 21/35] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:42.161211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 15/36] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:42.192175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.197835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.240693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.324084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be99e1-45d6-4f00-b71f-b0def5aa766c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.349959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd639-b994-4522-96fb-b8ca27bd2dae None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.364837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.365493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.365888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.366170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.367035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:42.368479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.389790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 22/37] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Jul 25 22:38:42 2022] POST /identity/v3/roles => generated 223 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:42.390921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.391580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.391868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.392147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.405978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:42.413374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:42.414296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:42.415038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 16/38] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:42.422422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.467942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.541105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e757e-f29d-4475-96f5-9cd58026a88b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.581514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.582190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.582477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.582755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.583494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:42.583804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:42.585289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79592e75-70ad-4462-b772-16c59dd91eed None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.594552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 23/39] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:42.600380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.625676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50724-5db8-4e61-a6b4-6d672e8b4a36 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.626168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50724-5db8-4e61-a6b4-6d672e8b4a36 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.626448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f50724-5db8-4e61-a6b4-6d672e8b4a36 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.628485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 24/40] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:42.633874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.634159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.634439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.652735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:42.653937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:42.688470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.711020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba1bc-af1e-4306-8eee-f274b1837fd8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.721101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 25/41] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:42.743029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.743909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.744592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.744881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.745150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.746754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:42.748383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.749994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 17/42] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:42 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:42.755991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.772788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.844713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b029c0-c19a-4e82-a1b7-238eaba04335 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.855157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba0505-9716-4dd8-9a2a-accc419f75cc None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:42.879456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.880110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.880434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.880717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.881894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:42.883351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.884984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 26/43] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:42.888585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:42.889238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:42.889680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:42.889891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:42.890459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.891071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:42.892560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:42.894143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 18/44] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:42.899620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:42.915110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.985810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:42.993046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26ce54-09eb-49d6-9761-1802532ab6af None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:43.004088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acf6c9-b5da-4a7d-9a58-e8de0a385c99 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:43.028912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:43.029548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:43.029835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:43.030115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:43.030815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:43.032322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c101a04-8b42-4233-a5f7-0ce08f9883e0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:43.038677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:43.039402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:43.039687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:43.040051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] PATH_INFO: `/v3/domains/default/users/f76f4c331aa04a1a86326998b6795006/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:43.042619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f76f4c331aa04a1a86326998b6795006, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:43.044650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a9e900-c6fd-4165-9134-fedd4b66f7f3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:43.059444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 19/45] 10.222.0.59 () {58 vars in 1361 bytes} [Mon Jul 25 22:38:42 2022] PUT /identity/v3/domains/default/users/f76f4c331aa04a1a86326998b6795006/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:38:43.059686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 27/46] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:38:42 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:38:45.037391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c2e0-d0ca-4227-8412-f26ccf03a41e None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.037912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c2e0-d0ca-4227-8412-f26ccf03a41e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.037994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c2e0-d0ca-4227-8412-f26ccf03a41e None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.039318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 20/47] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:45.044734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.045099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.045392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.063140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:45.064361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:45.082516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1cdad-6bd0-47e8-9c0b-41f879d69894 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.082801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1cdad-6bd0-47e8-9c0b-41f879d69894 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.083077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1cdad-6bd0-47e8-9c0b-41f879d69894 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.084445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 21/48] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:45.089257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.089798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.090073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.107960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:45.109174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:45.131510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 28/49] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:45.154093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.178702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 22/50] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:45.200353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.203138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.230751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.252751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fe8a4-23f2-4e2d-9615-4019e5f64426 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.287157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.287876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.288099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.288426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.298377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:45.298578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ec7da-4347-4186-88f8-090c491ed06b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:45.303344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:45.304202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:38:45.305017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 29/51] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:45.310182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.332420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.333080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.333364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.333640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.334801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.336256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.337874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 23/52] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:45.343694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.406937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b1ddf-6240-446c-a00c-042e0a4c7292 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.411812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.440903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63057f-dabc-4de5-bb8e-42d901cea7dc None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.441431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.442101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.442383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.442653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.443366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:45.443668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.445110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.449972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.458405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 30/53] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:45.459387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.476506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.477135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.477420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.477709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.478395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.479853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.507821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 24/54] 10.222.0.59 () {60 vars in 1140 bytes} [Mon Jul 25 22:38:45 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:38:45.563079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13703a-08d7-4189-915a-d78ac50038d3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.599819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.600515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.600802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.601083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.602309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.603780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.605464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 31/55] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:45.611214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.716396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ae794-ca54-4d69-968e-6a652384b7fc None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.738874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.750865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.751518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.751807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.752639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.753809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.755271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99591012-1ced-43d0-b0d6-327c9d494a9e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.756911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 25/56] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:45.762677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:45.829071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:45.865863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a257d-9ac4-4c78-ac50-b671035a0a6a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:45.898776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:45.899396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:45.899684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:45.899959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:45.900776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.domain.id=default, user.id=f76f4c331aa04a1a86326998b6795006) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:45.901085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:45.902528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ef2ba3-e86c-4b01-87f3-62d4e71cd22b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:45.908117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 32/57] 10.222.0.59 () {56 vars in 1322 bytes} [Mon Jul 25 22:38:45 2022] GET /identity/v3/role_assignments?user.id=f76f4c331aa04a1a86326998b6795006&scope.domain.id=default&role.id=e3f77a14908d48e99043f557a465098a => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:47.511460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac0a6-c955-4b98-a5b4-a6d1e918eade None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:47.511944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac0a6-c955-4b98-a5b4-a6d1e918eade None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:47.511944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ac0a6-c955-4b98-a5b4-a6d1e918eade None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:47.513334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 26/58] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:47.519050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:47.519462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:47.519605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:47.537857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:47.539035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:47.604499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 33/59] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:47.627725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac0a6-c955-4b98-a5b4-a6d1e918eade None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:47.726326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ac0a6-c955-4b98-a5b4-a6d1e918eade None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:47.761990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:47.762558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:47.762840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:47.763115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:47.764262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:47.765761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a905562-19ca-47f9-8c92-4f56a46cc6fe None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:47.767340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 27/60] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:47.773334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:47.831615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:47.868936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b26a9-e778-41cb-abb3-672651ec2236 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:47.903460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:47.904078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:47.904384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:47.904663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:47.905341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:47.906792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc589-fb5b-4f21-8123-0286ae7608e9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:47.933036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 34/61] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:38:47 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:38:50.919776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1e401-bed6-4b28-a945-ba11b1820ebf None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:50.920354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1e401-bed6-4b28-a945-ba11b1820ebf None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:50.920354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1e401-bed6-4b28-a945-ba11b1820ebf None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:50.921961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 28/62] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:50.927336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff006-e3c7-4dec-9cbe-0c1a3569c6aa None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:50.928142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff006-e3c7-4dec-9cbe-0c1a3569c6aa None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:50.928653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ff006-e3c7-4dec-9cbe-0c1a3569c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:50.957314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-239ff006-e3c7-4dec-9cbe-0c1a3569c6aa None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:50.958845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-239ff006-e3c7-4dec-9cbe-0c1a3569c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:51.050692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 35/63] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:51.093754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1e401-bed6-4b28-a945-ba11b1820ebf None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.169061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.226151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1e401-bed6-4b28-a945-ba11b1820ebf None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.230759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628e01-235e-48e5-bc9a-92c4fb970d73 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.231228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628e01-235e-48e5-bc9a-92c4fb970d73 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.231687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b628e01-235e-48e5-bc9a-92c4fb970d73 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.233478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 36/64] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:51.239840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82a0d-2ac5-4049-98ff-b2140d370ddd None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.240386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82a0d-2ac5-4049-98ff-b2140d370ddd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.241181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82a0d-2ac5-4049-98ff-b2140d370ddd None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.242988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 37/65] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:51.244490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.244989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.245457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.268382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:51.269835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.269988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:51.270788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.271217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.271636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.289088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-20d8cdcf-ceb6-4614-96bc-f4f78f692c3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:51.295997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:51.296888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:51.297745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 29/66] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:51.298383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.299169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.299589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.321857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:51.322059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.323072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:51.348658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 38/67] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:51.349841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.427524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 30/68] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:51.429131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.491323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.494057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcece7e1-e09e-4c26-8ff6-4b55aa9acd79 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.532440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.533915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.534268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.534643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.535499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:51.535911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:51.537559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:51.547446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 39/69] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:51.549690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.556759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9a04d-efef-4494-97ed-7af2597e27f7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.597388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.598087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.598424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.598700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.602661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.610099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:51.615658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:51.616549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:51.617293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:51.621638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 31/70] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:51.622513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.670968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdd473-f5f2-47d4-a8e3-53ca81cb7fe3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.705861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.706502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.706786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.707061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.717210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-10a18eb7-666a-4567-b527-55ce7308274c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:51.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:51.723593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:38:51.724409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 40/71] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:51.725159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e5892-05e8-482c-9087-db1910f05a17 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.725159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e5892-05e8-482c-9087-db1910f05a17 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.725445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e5892-05e8-482c-9087-db1910f05a17 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.726680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 41/72] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:51.727380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e5892-05e8-482c-9087-db1910f05a17 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.734996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a7164-7114-4f52-8dd7-c8fce3ba8a32 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.745407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.769952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.770589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.770872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.771152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.785838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:51.787316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbbc32-4c91-4afe-8d9f-97d1af5177a1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:51.788983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 32/73] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:51.790134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e60e-c8e9-43b8-abd4-e4d5b5606a6c None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.790423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e60e-c8e9-43b8-abd4-e4d5b5606a6c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.790701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520e60e-c8e9-43b8-abd4-e4d5b5606a6c None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.792061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 33/74] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:51.796219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520e60e-c8e9-43b8-abd4-e4d5b5606a6c None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.828029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:51.832795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e5892-05e8-482c-9087-db1910f05a17 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.865527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.866158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.866446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.866730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.867456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:51.867769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:51.869205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaedf6-cc1a-4949-b4a2-c7e4efe0baa6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:51.879042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 42/75] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:51.880240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2dbb-8868-4197-9ed2-733af29d0ab3 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.880561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2dbb-8868-4197-9ed2-733af29d0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.880843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2dbb-8868-4197-9ed2-733af29d0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.897680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-66ce2dbb-8868-4197-9ed2-733af29d0ab3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:51.898904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-66ce2dbb-8868-4197-9ed2-733af29d0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:51.900263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520e60e-c8e9-43b8-abd4-e4d5b5606a6c None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:51.936586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:51.937189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.937472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.937749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.938467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:51.938776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:51.940742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:51.951812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 34/76] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:51.952634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:51.968846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 43/77] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:51.970098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:51.970407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:51.970695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:51.987962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:51.989170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:51.996222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.055830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 44/78] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:52.068467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.068566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486f51-4b6d-45a7-b1c5-331b57d04276 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.080962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.100131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931368-36df-422c-a309-b8a3796896ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.100802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931368-36df-422c-a309-b8a3796896ee None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.101086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931368-36df-422c-a309-b8a3796896ee None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.101363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931368-36df-422c-a309-b8a3796896ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.155804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b91a0-4254-4fe5-9278-76dc92a1da34 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.173002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931368-36df-422c-a309-b8a3796896ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.174615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931368-36df-422c-a309-b8a3796896ee None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.189954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248323d-4863-411c-a344-414832e2c097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.190604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248323d-4863-411c-a344-414832e2c097 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.190888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248323d-4863-411c-a344-414832e2c097 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.191161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248323d-4863-411c-a344-414832e2c097 None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.192343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248323d-4863-411c-a344-414832e2c097 None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.193772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248323d-4863-411c-a344-414832e2c097 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.195537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 45/79] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:52.196212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248323d-4863-411c-a344-414832e2c097 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.203418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.272006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 35/80] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:38:52.272791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931368-36df-422c-a309-b8a3796896ee None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.289868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.299643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248323d-4863-411c-a344-414832e2c097 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.333119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.333760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.334045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.334328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.335507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.336984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.338747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 46/81] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:52.339587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.374745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931368-36df-422c-a309-b8a3796896ee None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.405080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.411668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.412328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.412619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.412900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.422796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:52.427827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:52.428868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:52.429674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 36/82] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:52.430318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.439820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd1fb-e072-4211-9762-a0d0cb9fa6ee None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.474968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.475617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.475894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.476166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.477487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.479080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.480711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 47/83] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:52.481482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.509602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.529545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb3fa0-4817-4f0c-92f5-945c720f798f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.562233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.562850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.563132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.563408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.581606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fb8c1-39a0-430d-9fc0-6a376dc02e65 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.619529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.620188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.620501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.620791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.621819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.621936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.623639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.625377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 48/84] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:52.626149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.633795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.635337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.716628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.724217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b2387-b23b-4227-a14b-b142fe17ca9f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.730520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 37/85] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:38:52.731358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.757184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.757801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.758080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.758357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.819030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.824448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.825900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.828964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e987aa-bd03-4134-8ffb-e476e4580dba None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:52.863236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:52.864050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:52.864414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:52.864697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:52.865417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:52.865725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:52.867098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:52.875087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 38/86] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:52.875843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.916220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:52.924298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 49/87] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:38:52.925130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:52.990235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82556c-1960-41c8-b8de-c749448a2fd4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.025322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.025949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.026242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.026522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.027213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.028700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.031669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159343a-a133-42e2-b182-9a12e5e674a7 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.054590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 39/88] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:38:52 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:53.055404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.067359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.067900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:53.068004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.068306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.068668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.070235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:53.070372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.072095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.078744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 50/89] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:52 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.080475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.175490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:53.191031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50077570-6d97-4a8a-86f7-fa081bebc357 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.235906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60e512-a29e-4aad-b2df-6c81b3e84828 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.245935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.246640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.247609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.247609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.248952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.252442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.255150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 40/90] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.260184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.286120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.286780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.287062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.287338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.289014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.290473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.292084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 51/91] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.292961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.362514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:53.391600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7afda-0e9d-44ca-8f55-42c36f4c2d02 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.428352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74895-e2e0-4f34-a6aa-ef7cdcc19b4b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.432787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.433519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.433808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.434103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.436037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.437537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.439986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 41/92] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.440740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.464602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:53.474579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.476012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.476533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.477280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.478461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=f76f4c331aa04a1a86326998b6795006) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:53.479430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.481587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.490161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 52/93] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/role_assignments?user.id=f76f4c331aa04a1a86326998b6795006&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.491391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:53.580557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30960fce-bc69-476b-a3a0-ec58198d5e60 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.663850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.665269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.665563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.666066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.692319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:53.694303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eab07a-a44c-4c3b-a327-b800a79f5894 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:53.757775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.759937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.777651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:53.778292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:53.778579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:53.778856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:53.779666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:53.779978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:53.781466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:53.798245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 53/94] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:53.927771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 42/95] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:38:53.933380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:54.026744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:54.084355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7b945-19c5-40d2-af40-611142e4d8e4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:54.119927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:54.120602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:54.120886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:54.121161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] PATH_INFO: `/v3/projects/8a64a6dc334d4354ba44ed862fc8421f` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:54.122322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] RBAC: Authorizing `identity:get_project(project_id=8a64a6dc334d4354ba44ed862fc8421f)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:54.123762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511caa3-77f8-4803-bc09-7e7f379780fe None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:54.127525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 54/96] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:53 2022] GET /identity/v3/projects/8a64a6dc334d4354ba44ed862fc8421f => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:54.138046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:54.214557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:54.287442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ca140-e075-4413-b6a4-0a22691b9e18 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:54.331009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:54.331973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:54.332589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:54.333093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:54.334077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=8a64a6dc334d4354ba44ed862fc8421f, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:54.334626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:54.336374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46a81b-d9a8-483e-a1b9-75293d386ea7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:54.348812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 43/97] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:54 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=8a64a6dc334d4354ba44ed862fc8421f&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:55.735127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cc59-6f13-40b1-8480-5511b1381a29 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:55.735634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cc59-6f13-40b1-8480-5511b1381a29 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:55.735706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3cc59-6f13-40b1-8480-5511b1381a29 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:55.737955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 55/98] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:55.743109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:55.743495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:55.743654 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:55.769237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:55.770424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:55.824032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32882d1-0b83-43fb-93b2-045ad6b3767e None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:55.824345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32882d1-0b83-43fb-93b2-045ad6b3767e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:55.824627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32882d1-0b83-43fb-93b2-045ad6b3767e None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:55.826130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 56/99] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:55.831777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:55.832069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:55.832378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:55.869311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:55.870535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:55.882981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 44/100] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:55.927248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.013505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.024269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 57/101] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:56.059762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.127838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb0e4-39df-4748-bfce-1725b377cf95 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.171110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.194958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.195958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.196467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.196932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.217396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:56.222827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:56.223637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:38:56.224504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:56.227040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 45/102] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:56.233523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.268093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209a7-f055-4d2d-8736-9acdae14e4c7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.331884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.332917 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.333397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.333862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.354051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:56.361450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:56.362335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:38:56.363093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 58/103] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:38:56.370147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.414907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.419086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d2e6-93ef-44ed-9fb1-0b1509f734e4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.498366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.499244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.499674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.500094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.501026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:56.502040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:56.503598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:56.508412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dd9b0-5114-4a75-8f3a-12c3661b3f71 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.523827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 46/104] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:56.529690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.534379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.580790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.581485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.581773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.582052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.582856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:56.583169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:56.584622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9797d6-44ec-4574-a7f1-f20b3778162c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:56.601908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 59/105] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:38:56.603441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001298-6edb-4a6d-a41b-95762d134600 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.603729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001298-6edb-4a6d-a41b-95762d134600 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.604009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001298-6edb-4a6d-a41b-95762d134600 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.605282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 60/106] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:56.611438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.611781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.612070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.632313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:56.633530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:56.727621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a79876-1264-4634-9581-a5f69227ca8a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.746495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 61/107] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:38:56.747517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.778443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.780625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.780914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.781196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] PATH_INFO: `/v3/users/60009e282cb44e6aac29e54e812c3e02` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.801975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] RBAC: Authorizing `identity:get_user(user_id=60009e282cb44e6aac29e54e812c3e02)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:56.804339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1916-516b-4c0d-b115-041c269e9672 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:56.807363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 47/108] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/users/60009e282cb44e6aac29e54e812c3e02 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:56.808982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0799-350c-46de-9eb8-2c28a482e596 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.809473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0799-350c-46de-9eb8-2c28a482e596 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.809969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a0799-350c-46de-9eb8-2c28a482e596 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.811423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 48/109] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:56.813034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0799-350c-46de-9eb8-2c28a482e596 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:56.838648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.881286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34723013-5c23-4b44-9d0f-3efbe9e8273a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.884350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:56.918329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.919068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.919610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.919610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.920874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:56.922304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd2b65-cd2e-4a95-bfef-20f7d1893a1a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:56.924695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 62/110] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:56.925860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b630b-96ae-4d02-9796-ccec2465bc04 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.926148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b630b-96ae-4d02-9796-ccec2465bc04 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.926427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b630b-96ae-4d02-9796-ccec2465bc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.938046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a0799-350c-46de-9eb8-2c28a482e596 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:56.943780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-598b630b-96ae-4d02-9796-ccec2465bc04 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:56.944982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-598b630b-96ae-4d02-9796-ccec2465bc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:56.977870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:56.978521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:56.978803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:56.979084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:56.990354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:56.995307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:56.996357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:56.997146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 49/111] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:56.997766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 63/112] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9fca5-f857-4782-82f8-108bcb8d622a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9fca5-f857-4782-82f8-108bcb8d622a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9fca5-f857-4782-82f8-108bcb8d622a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 64/113] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:57.044383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9fca5-f857-4782-82f8-108bcb8d622a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.100685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.124223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05295c-d7a5-459d-8a34-e97b20eac564 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.155477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9fca5-f857-4782-82f8-108bcb8d622a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.157069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.166912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.167541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.167832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.168108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.192659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.193313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.193597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.193876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.195041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.196511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.198172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 65/114] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.198939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.248338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.250265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.302926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa32b2-ea8a-449e-8644-24125dc26085 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.336579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.336849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.337263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.337925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.338215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.338992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:57.339517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.340926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d944b5-d43e-4ff3-9d9e-0cfa50a27070 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.349380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 66/115] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.350563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.350859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.351140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.368377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 50/116] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:38:57.369178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:57.369627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.370434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:57.396899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.437847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 67/117] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:57.438882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.467488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea7ac7-df9f-49b1-86ee-9c0e4e9e641e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.501343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.502020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.502292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.502569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.512403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:57.517347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:57.518296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:38:57.519052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 51/118] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:57.519661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.539514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ed756-6fa8-4076-9333-55e539f69d24 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.560503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.573799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.574474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.574756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.575032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/users/680759d871b04ab9abba3a7a9c3000f2/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.576969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, user_id=680759d871b04ab9abba3a7a9c3000f2, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.578407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215ddcd-b244-445f-b1b4-d9eb50bb5649 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.592230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 68/119] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:38:57 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/users/680759d871b04ab9abba3a7a9c3000f2/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:38:57.604651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc9bb-e231-4cbc-a28a-dd3f76c87c48 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.604651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc9bb-e231-4cbc-a28a-dd3f76c87c48 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.604651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fc9bb-e231-4cbc-a28a-dd3f76c87c48 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.604651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 69/120] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:57.604651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fc9bb-e231-4cbc-a28a-dd3f76c87c48 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.627568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.628995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741b4c6-b7ec-4e60-94b9-1e416757f537 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.668368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.669035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.669321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.669601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.670837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.672404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.674649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 52/121] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.675453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.725705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fc9bb-e231-4cbc-a28a-dd3f76c87c48 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.769322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.769960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.770049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.770285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.771478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.772969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.774797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 70/122] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.775396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.787489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42574a-9e28-4103-856d-3daa2b1fd59a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.795560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.826774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.827709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.828175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.828653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.830020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.831849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f8111-0741-4b09-95c6-b29899a3a8ea None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.834031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 53/123] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.835598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.836144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.836648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.854806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:57.856306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:57.878700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:57.888867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0b2ab-f3ad-48ff-9013-564ff93bba29 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:57.923701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:57.924384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:57.924700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:57.924956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:57.925687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:57.925999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:57.927381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:57.929799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 54/124] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:57.931052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:57.946418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 71/125] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:57.946418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.048024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82171aeb-6349-46d4-8246-a1eed5f69ddd None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.050998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.056365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b340be8-2922-4508-81f4-bd950370d0de None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.088554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.089398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.089687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.089967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.091141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.092702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.094409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 55/126] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:58.095174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.101926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.102945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.102945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.103111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.103955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=60009e282cb44e6aac29e54e812c3e02) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:58.104322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.105755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.112195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 72/127] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:38:57 2022] GET /identity/v3/role_assignments?user.id=60009e282cb44e6aac29e54e812c3e02&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:58.113101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.148340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.240202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90168fe9-fcb2-4cf9-a00c-3487f3f0160b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.260647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b789-da66-4f7d-a74e-b66c77613814 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.284771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.285694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.286155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.286641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.287529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.289196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.299915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.300688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.301043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.301393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.302697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.304260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.310521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 73/128] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:58 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:58.310521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.330625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 56/129] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:38:58 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:38:58.331560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.363895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.411342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.430308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b673319-2fd6-4705-b12e-e5fe351e1f8b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.464659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216f4b-2571-4ad5-a696-90cb4e8110ec None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.468138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.468840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.469127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.469406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.482042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:38:58.488532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:38:58.489435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:38:58.490313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 74/130] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:38:58.490953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.504399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.505285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.505725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.506124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/users/f76f4c331aa04a1a86326998b6795006/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.508504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, user_id=f76f4c331aa04a1a86326998b6795006, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.510219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.556644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 57/131] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:38:58 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/users/f76f4c331aa04a1a86326998b6795006/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:38:58.557814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.651410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb680b91-64d6-4816-bb61-59578eb41771 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.727924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.728616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.728898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.729174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.732532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.734083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.738236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 75/132] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:58 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:58.745424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.751118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.764325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:58.781467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a82098-e4f2-4109-9185-a3f1057bbf06 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.825697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.826433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.826721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.827009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.827755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:38:58.828129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.830205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.841002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 58/133] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:58.847611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:58.861481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195f52-7833-4c79-9086-9380a1a52d78 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:58.897191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:58.897874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:58.898158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:58.898437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/users/680759d871b04ab9abba3a7a9c3000f2/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:58.902488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, user_id=680759d871b04ab9abba3a7a9c3000f2, role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:58.903891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:58.930307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 76/134] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:38:58 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/users/680759d871b04ab9abba3a7a9c3000f2/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:38:58.991696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0d1b6-e7bc-4b1a-938c-0a07f1a603be None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:59.034401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:59.035142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:59.035441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:59.035623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:59.037022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:59.038525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:59.040554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 59/135] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:38:58 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:59.046319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:59.123902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:59.157649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bbb41-01aa-4a90-a867-297f21406d9c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:59.194475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:59.195153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:59.195486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:59.195773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] PATH_INFO: `/v3/projects/8a64a6dc334d4354ba44ed862fc8421f` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:59.197064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] RBAC: Authorizing `identity:get_project(project_id=8a64a6dc334d4354ba44ed862fc8421f)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:59.198531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9a54-11c9-49d5-91ef-3463741caf96 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:59.204994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 77/136] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:38:59 2022] GET /identity/v3/projects/8a64a6dc334d4354ba44ed862fc8421f => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:38:59.207186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:38:59.224836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:38:59.329579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5771-c3bc-45c6-819b-7382ad8818f0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:38:59.376863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:38:59.377569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:59.377856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:59.378132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] PATH_INFO: `/v3/projects/8a64a6dc334d4354ba44ed862fc8421f/users/680759d871b04ab9abba3a7a9c3000f2/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:59.380138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a64a6dc334d4354ba44ed862fc8421f, user_id=680759d871b04ab9abba3a7a9c3000f2, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:38:59.381641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8cf7d-253a-4ce6-a4bf-72f224467082 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:38:59.403574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 60/137] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:38:59 2022] PUT /identity/v3/projects/8a64a6dc334d4354ba44ed862fc8421f/users/680759d871b04ab9abba3a7a9c3000f2/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:38:59.828954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74760-3c7b-404a-98b7-56f385b67743 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:59.829377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74760-3c7b-404a-98b7-56f385b67743 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:59.829554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b74760-3c7b-404a-98b7-56f385b67743 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:59.831244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 78/138] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:38:59.837662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:38:59.838125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:38:59.838222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:38:59.866840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:38:59.868060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:38:59.946605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 61/139] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:38:59.980259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b74760-3c7b-404a-98b7-56f385b67743 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:00.101238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b74760-3c7b-404a-98b7-56f385b67743 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:00.145665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:00.146336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:00.146619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:00.146894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:00.162976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:00.168678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:00.169517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:00.170281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:00.170851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 79/140] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:00.172852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:00.176966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:00.180624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:00.311044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6eae0-d1f8-4f1c-af1b-d054b5a5e529 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:00.351819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:00.352402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:00.352699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:00.352986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:00.353724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:00.354037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:00.355444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:00.363964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 62/141] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:00.370729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:00.491543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a724-2119-425a-8d67-0ab1ad4bdec2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:00.526584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:00.527237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:00.527518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:00.527799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:00.529017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:00.530479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:00.532250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 80/142] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:00 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:00.537874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:00.617613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:00.657215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634039ef-477a-41c8-8617-eb37779169c1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:00.700832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:00.701463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:00.701748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:00.702027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:00.776968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:00.778476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:00.864674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:00.902838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 63/143] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:00.908463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:00.980836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:01.017156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbca38e-b0b0-482f-b9eb-966cd097e4cb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:01.052247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:01.052937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.053210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.053486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.054656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:01.056122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc4c4e-1bdf-4215-a856-d549e2338281 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:01.058050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 81/144] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:00 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:01.064461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:01.187164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e6aab-72b0-47a8-a38b-7eeb7bab514d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:01.235381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:01.236612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.236896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.237171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.237980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:01.238295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:01.239768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0203a7-0d65-47a9-9494-c77653e84f5e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:01.246651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 64/145] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:01 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:01.350874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a946-b061-4d5f-9c15-04c70bc5825b None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.351186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a946-b061-4d5f-9c15-04c70bc5825b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.351434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2369a946-b061-4d5f-9c15-04c70bc5825b None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.353021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 82/146] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:01.366760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b186b-9897-421f-8811-cc02efd05c3e None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.367057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b186b-9897-421f-8811-cc02efd05c3e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.367336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b186b-9897-421f-8811-cc02efd05c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.401013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-8d3b186b-9897-421f-8811-cc02efd05c3e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:01.402244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-8d3b186b-9897-421f-8811-cc02efd05c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:01.439713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:01.491249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 65/147] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:01.512965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369a946-b061-4d5f-9c15-04c70bc5825b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:01.632910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2369a946-b061-4d5f-9c15-04c70bc5825b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:01.640125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7123e3d-bea6-42c0-9e41-1b7e46b7c6bb None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.640454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7123e3d-bea6-42c0-9e41-1b7e46b7c6bb None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.640735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7123e3d-bea6-42c0-9e41-1b7e46b7c6bb None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.642724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 66/148] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:01.647749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.648041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.648347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.675258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:01.676479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:01.714303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:01.716888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.717417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.717704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.725203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:01.743482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:01.755489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:01.756444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:01.757241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:01.757858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 83/149] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:01.779534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:01.825627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 67/150] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:01.870426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:01.930667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd39b4-c656-4fae-9c54-7aea2e972dc9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:01.967741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:01.968843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.969346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.969855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.970864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:01.971378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:01.973086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454583-a903-4b0b-b051-3a08430dabfe None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:01.982572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 84/151] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:01.984643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8574-e109-4b19-a139-a2caff2dab55 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.985148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8574-e109-4b19-a139-a2caff2dab55 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.985669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e8574-e109-4b19-a139-a2caff2dab55 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.987179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 85/152] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:01.992711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:01.993356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:01.993865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:01.996276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.008434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa10df-0767-4f7a-a4e8-3fd1220141e7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.016051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:02.018280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:02.050875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.051978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.052274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.052618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.054055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.055516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.057594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 68/153] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:02.059224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.092682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.096337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 86/154] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:02.097525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.191759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e323d-d1b7-4bde-9054-98a8f054be18 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.220011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009e985-050b-41f7-9f53-6e873fe4d0c2 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.228977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.229960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.230458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.230977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] PATH_INFO: `/v3/users/60009e282cb44e6aac29e54e812c3e02` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.232406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] RBAC: Authorizing `identity:get_user(user_id=60009e282cb44e6aac29e54e812c3e02)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.234081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.236018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 69/155] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/users/60009e282cb44e6aac29e54e812c3e02 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:02.237026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.261485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.261844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.262025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.262293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.262989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.264495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.269467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.290741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 87/156] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:02 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:02.291409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.348146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.355007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ed6cb-9712-4437-ac7a-955ee149f712 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.394366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.395392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.395910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.396418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.409152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d6ec1229-4dc9-4421-8ed5-7784fbeb826a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:02.414737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:02.416582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:02.417701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:02.418304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c51cce-cecc-4b60-99f9-2c7590eb1117 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.420739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 70/157] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:02.422823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608f4-8b67-4bfb-b32f-348c4a898085 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.423425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608f4-8b67-4bfb-b32f-348c4a898085 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.423909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980608f4-8b67-4bfb-b32f-348c4a898085 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.426714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 71/158] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:02.434060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.434445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.434639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.453484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:02.455319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:02.474245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.475006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.475299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.475580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.477074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.478883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.480779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 88/159] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:02.485351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.545517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 72/160] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:02.546357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.567387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.607762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6f1a4-020e-4ea2-99f4-3705e9b99ced None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.621894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.655054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.655778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.656122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.656428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.657156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:02.658138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.659566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f63287d-2c84-477b-abc7-b48c270f1a8f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.670109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 89/161] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:02.671369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733d08-18f7-4fa5-8bef-c7089c80f95c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.671659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733d08-18f7-4fa5-8bef-c7089c80f95c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.671941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55733d08-18f7-4fa5-8bef-c7089c80f95c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.673673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 90/162] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:02.674426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55733d08-18f7-4fa5-8bef-c7089c80f95c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.683437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c31017-e160-4975-904d-a5486fb91cad None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.722988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.723680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.723966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.724443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/users/60009e282cb44e6aac29e54e812c3e02/roles/d89da1c8c54e4d498d049714e4904dfb` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.726450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, user_id=60009e282cb44e6aac29e54e812c3e02, role_id=d89da1c8c54e4d498d049714e4904dfb)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.728104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.751648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 73/163] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:02 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/users/60009e282cb44e6aac29e54e812c3e02/roles/d89da1c8c54e4d498d049714e4904dfb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:02.752639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:02.810600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55733d08-18f7-4fa5-8bef-c7089c80f95c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.851353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.852021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.852760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.852760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.866321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:02.866982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c520247f-f101-45a8-ba6c-f7084c24c029 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:02.873353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:02.874332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:02.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 91/164] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:02.877609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.877897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.878169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.902094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e1e34-e6f4-43f7-a6a1-817099a33f7c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:02.905270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:02.906645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:02.942967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:02.943398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:02.944440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:02.944927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:02.945488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] PATH_INFO: `/v3/users/f76f4c331aa04a1a86326998b6795006` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:02.947075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] RBAC: Authorizing `identity:get_user(user_id=f76f4c331aa04a1a86326998b6795006)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:02.948886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:02.950836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 74/165] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/users/f76f4c331aa04a1a86326998b6795006 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:02.951905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.035351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 92/166] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:03.036977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.103427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3229d-9963-479e-9d6c-ae522e89afd5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.152121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.153240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.153527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.153805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.154542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:03.155249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:03.157048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:03.170094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 75/167] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:03.171085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.181076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:03.189921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13c60a-8521-4c1c-a74c-eadf9bc15f9e None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.228993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.229622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.229903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.230179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.263479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:03.283398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6113a5-bb6e-48f8-a949-1a2eb510ff56 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.303859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:03.305600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:03.320115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.320953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.321331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.321706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.332859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:03.338831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:03.340239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:03.341246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:03.342412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 76/168] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:03.343340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.417926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:03.455577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9e086-dddb-4b37-87c5-f249d249a759 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.491182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 93/169] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:03.492027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.492153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.493154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.493633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.494124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.495607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:03.497304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:03.499147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 77/170] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:03.500132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.641353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:03.739981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9fa7d-0d4e-4264-83c7-d00542318d0c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.760050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f0e0a-2855-4990-9742-de32521e9bf2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:03.813921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.814695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.815076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.815447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.820316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:03.820316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:03.820316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:03.838493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 94/171] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:03.840706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.857925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:03.858934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:03.859413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:03.859907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:03.863852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:03.865590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:03.870301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 78/172] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:03.871342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:03.878897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:04.041896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f325f-dbdc-4a9a-bd8d-786ce91b6259 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:04.084748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af5bc4-5354-41a5-88ca-fdbdb5a1356c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:04.093583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:04.112523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:04.113169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:04.113456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:04.113737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:04.149842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:04.150491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:04.150771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:04.151042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] PATH_INFO: `/v3/users/680759d871b04ab9abba3a7a9c3000f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:04.152997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] RBAC: Authorizing `identity:get_user(user_id=680759d871b04ab9abba3a7a9c3000f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:04.154797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:04.156879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 79/173] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/users/680759d871b04ab9abba3a7a9c3000f2 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:04.158272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:04.270289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:04.271756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:04.274733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:04.327012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f1b79-bfd0-4ac8-8812-1805a2cb45e0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:04.379500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:04.380167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:04.380530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:04.380809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:04.381612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=f76f4c331aa04a1a86326998b6795006) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:04.381925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:04.383366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:04.390481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 80/174] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:04 2022] GET /identity/v3/role_assignments?user.id=f76f4c331aa04a1a86326998b6795006&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:04.391088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:04.545401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 95/175] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:04.551584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:04.606630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620365b-297b-44e3-851e-71d0eaafab48 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:04.624694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:04.695437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:04.696076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:04.696373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:04.696647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:04.702938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:04.808992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7d2ee-9830-49e1-b5d5-fab64e0ad3a7 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:04.843123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:04.844947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:04.892502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:04.893535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:04.894015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:04.894511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:04.895898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:04.897607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:04.899482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 96/176] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:04 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:04.909259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:04.988630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 81/177] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:04.996308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:05.050648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:05.064758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:05.069366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e565e2-641d-40db-aee1-7b4ecb4f2659 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:05.112004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:05.113020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.113518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.113989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.114986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:05.115512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:05.117233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:05.124074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 97/178] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:04 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:05.171264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851dc3-ade0-41d8-86da-5995b68eeef1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:05.223801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:05.224493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.224776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.225053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] PATH_INFO: `/v3/projects/8a64a6dc334d4354ba44ed862fc8421f` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.226271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] RBAC: Authorizing `identity:get_project(project_id=8a64a6dc334d4354ba44ed862fc8421f)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:05.227772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d92aae-ffe3-4fd9-a92c-b9a20ddca421 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:05.229588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 82/179] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:04 2022] GET /identity/v3/projects/8a64a6dc334d4354ba44ed862fc8421f => generated 312 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:05.236324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:05.378201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b675ed7-9883-47cf-a60b-a4f545ec6c34 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:05.423889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:05.424910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.425419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.425920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.426950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=8a64a6dc334d4354ba44ed862fc8421f, user.id=680759d871b04ab9abba3a7a9c3000f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:05.427473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:05.429201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5216112-6713-443a-a71b-5ac6a2bb3006 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:05.436233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 98/180] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:05 2022] GET /identity/v3/role_assignments?user.id=680759d871b04ab9abba3a7a9c3000f2&scope.project.id=8a64a6dc334d4354ba44ed862fc8421f&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:05.483285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646688-9c76-4817-9d0d-ac3395a71e59 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.483636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646688-9c76-4817-9d0d-ac3395a71e59 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.483837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b646688-9c76-4817-9d0d-ac3395a71e59 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.485345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 83/181] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:05.491265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.491571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.491833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.511033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:05.512258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:05.531201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:05.587699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 99/182] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:05.611727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646688-9c76-4817-9d0d-ac3395a71e59 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:05.735133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b646688-9c76-4817-9d0d-ac3395a71e59 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:05.736846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:05.780688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:05.781345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.781629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.781899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.794213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-018ead1a-f762-41b5-a990-7eeacbd6f6f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:05.799325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:05.800192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:05.801023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 84/183] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:05.806487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:05.819048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b8c0b-27f6-4ccb-9cd9-3409fa791d82 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.819335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b8c0b-27f6-4ccb-9cd9-3409fa791d82 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.819616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b8c0b-27f6-4ccb-9cd9-3409fa791d82 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.821022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 85/184] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:05.826918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520827-f734-4cb0-8657-d198e1e752ef None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.827201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520827-f734-4cb0-8657-d198e1e752ef None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.827477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520827-f734-4cb0-8657-d198e1e752ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.852894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e9520827-f734-4cb0-8657-d198e1e752ef None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:05.854073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e9520827-f734-4cb0-8657-d198e1e752ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:05.940240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae531bb8-ab67-4230-a194-e82cf6a81346 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:05.948835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 86/185] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:05.963371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36dca-d06b-4d63-8f94-64d126a1ccad None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.963371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36dca-d06b-4d63-8f94-64d126a1ccad None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.963371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d36dca-d06b-4d63-8f94-64d126a1ccad None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.965336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 87/186] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:05.972565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.972853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.973134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.987605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:05.988162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:05.988479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:05.988754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:05.989489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:05.989794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:05.991189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:05.995506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:05.997529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:06.004309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 100/187] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.004309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.021730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.074232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 88/188] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:06.077226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.101922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.109111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464513c-6fd0-497c-9a20-eb8c64ccfa41 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.143859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.144847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.145126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.145406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.146570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.148016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4051087-8210-4d13-b991-acd4c815d896 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.149640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 101/189] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.150763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f13e-5384-4a5d-bcde-1b478d442f29 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.151047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f13e-5384-4a5d-bcde-1b478d442f29 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.151324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f13e-5384-4a5d-bcde-1b478d442f29 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.154779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 102/190] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:06.154779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439f13e-5384-4a5d-bcde-1b478d442f29 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.179518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37cb959-8471-4d20-8a2f-05ac8e215c98 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.213834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.214730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.215247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.215247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.228093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.229601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.231253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 89/191] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.234002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.237158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.254271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439f13e-5384-4a5d-bcde-1b478d442f29 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.286588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.287229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.287909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.288184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.298682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2ecaa0e1-d4c8-466d-81ac-0bc23121327d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:06.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:06.305013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:06.305787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 103/192] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:06.306431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.307380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.307380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.318179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.324532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:06.326058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:06.337485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71653a-abb1-460d-803c-251f19bc5ce9 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.371193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.371808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.372093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.372402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.373090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.374537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.391456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 104/193] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:06.392405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.409185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 90/194] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:06 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:06.409185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.487230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.521553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6b05c-9c9f-4449-9492-35355f0f5c21 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.524470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5858a3-ed0e-44f4-a2cc-588ac4ecf09a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.560788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.560788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.561072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.561361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.564723 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.565357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.565635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.566694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.566694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:06.566960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.569184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.571494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.581284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 91/195] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.582121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.645894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.647895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.707873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e83f0-ffd9-41f1-a608-4ecbef0e82d2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.733097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.746402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.747058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.747341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.747617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.769010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 105/196] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:06.769531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:06.769863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:06.776485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:06.777372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:06.778154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:06.780727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 92/197] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:06.782261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.862127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:06.883583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2e422-613c-493d-a3ad-2c2f9e3ecdd8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.917899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2922-23f4-44bb-99f9-a391142a0e10 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:06.921642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.921784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.922141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.922512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.924331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.925860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.928225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 106/198] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.928959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.959972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:06.960852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:06.961273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:06.961643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:06.963161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:06.964887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:06.966728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 93/199] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:06.967551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:06.985572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.063422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f81a8e-623e-4420-9f4e-592700218dbf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.076124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f543f-01f7-4501-9e31-fdeb24142505 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.111541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.111740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.112391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.113157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.113157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.113667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:07.113975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.115597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.124706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 107/200] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:07.125578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.125731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.126691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.127155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.127553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.213318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.215056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.245422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5868e3f-d017-425a-b05b-b61e87466b4e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.247673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.293954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.294584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.294864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.295139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.295945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=e31de7d4f6754819acbe341303cc06ee) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:07.296254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.298519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.308685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 108/201] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/role_assignments?user.id=e31de7d4f6754819acbe341303cc06ee&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:07.309898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.329017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 94/202] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:07.335698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.381756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.435267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9548a-a641-4349-93b3-ec820b8468ca None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.474295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.475342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.475851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.476380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] PATH_INFO: `/v3/users/60009e282cb44e6aac29e54e812c3e02` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.477785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] RBAC: Authorizing `identity:get_user(user_id=60009e282cb44e6aac29e54e812c3e02)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.479444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.481426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 109/203] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/users/60009e282cb44e6aac29e54e812c3e02 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:07.491548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.530714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.537878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79257e2a-d677-4ada-bfe1-9e7a07f2e7d5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.606050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.606552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e717fa-e797-47a8-a1d3-678ebd779590 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.606661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.606881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.607154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.608331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.610971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.620688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 95/204] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:07.621322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.645319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.646801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.647520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.648220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.721369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.723278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.760638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.835851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 110/205] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:39:07.843174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:07.864636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:07.873484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05845d8-f0e3-4c13-a726-3b0e399bb789 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.930753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.931391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.931673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.931952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.932796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=e31de7d4f6754819acbe341303cc06ee) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:07.933106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.934582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.947646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7eb4e6-87c3-45d0-81bc-d3d3ee9bc0ff None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:07.950814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 96/206] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/role_assignments?user.id=e31de7d4f6754819acbe341303cc06ee&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:07.987437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:07.988562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:07.989057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:07.989529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:07.990936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:07.992637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf42b8-9855-47c0-8fb8-f01b0db92a3b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:07.994824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 111/207] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:07 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:08.005713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:08.180277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e1a4e-49de-4b30-99dd-959d0a7d0527 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:08.223650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:08.224351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:08.224585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:08.229356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:08.229356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, scope.project.id=487df376a9e74299a45758c37395c1f2, user.id=60009e282cb44e6aac29e54e812c3e02) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:08.229356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:08.229356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff7f8-8a88-4663-8495-3591a5473766 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:08.234242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 97/208] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:08 2022] GET /identity/v3/role_assignments?user.id=60009e282cb44e6aac29e54e812c3e02&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:08.693189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25d3e-4101-4744-92d5-4f50a3ebc8b8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:08.693697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25d3e-4101-4744-92d5-4f50a3ebc8b8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:08.693802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c25d3e-4101-4744-92d5-4f50a3ebc8b8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:08.695387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 112/209] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:08.700346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:08.700639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:08.700918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:08.720783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:08.721970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:08.745051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:08.788056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7816-d2b9-4797-8228-8afcfa06b5a1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:08.788489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7816-d2b9-4797-8228-8afcfa06b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:08.788709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7816-d2b9-4797-8228-8afcfa06b5a1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:08.790296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 113/210] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:08.796518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:08.796796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:08.797068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:08.803835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:08.812315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 98/211] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:08.819455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:08.820837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:08.838260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:08.898547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 114/212] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:08.922745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:08.964159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dce4d9-5d6b-45ba-85a3-2538ae3a1143 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.008940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.009752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.010037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.010294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.024461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:09.030635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:09.031528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:09.032908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 99/213] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:09.039206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.041589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d49eb6-f524-43bf-b9f9-66fd4ed926d1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.063805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:09.081432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:09.089646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.090524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.090980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.091671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.093889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.096054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.097855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 115/214] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:09.105067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.180385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485472f-d782-417a-850b-e5bdc2174faa None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.224474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.225088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.225331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.225562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.226291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:09.226604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.228601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.239835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 100/215] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:09.240417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca131e-6557-45fd-85de-6895f7d4211a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.245978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.280686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.281652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.282743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.283241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.284169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.285822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.310385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 116/216] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:09 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:09.338277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:09.369655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d6399-edc7-4362-8533-af6f70972f86 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.408926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.409594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.409877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.410151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] PATH_INFO: `/v3/users/2b20c03d55e94faea2b9ced8adc3dde3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.425540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=2b20c03d55e94faea2b9ced8adc3dde3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.427038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12846af2-8d01-411b-b69f-1a4b91238fe9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.429004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 101/217] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/users/2b20c03d55e94faea2b9ced8adc3dde3 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:09.434469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.502895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:09.549683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ac7f7-8623-4a92-92b1-ce1ac7e2224c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.585885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.586521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.586813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.587088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.657508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.659015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.716310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb358fa-2636-4a30-9619-ae392e748803 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.716499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb358fa-2636-4a30-9619-ae392e748803 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.716735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb358fa-2636-4a30-9619-ae392e748803 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.717474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:09.718005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 102/218] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:09.726073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.726384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.726635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.757317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:09.758440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:09.773318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 117/219] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:09.778904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.851041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 103/220] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:09.873349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.901790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ccb21-28cc-41ff-89e4-b87a0131d890 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:09.957055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:09.957712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:09.957990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:09.958263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:09.960067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:09.961756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:09.963671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 118/221] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:09.970762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:09.985591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.014021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.061332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44989c-b57e-4016-be9a-f688373cf77c None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.121408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224d17-42c2-4b9d-bd55-738c50b7abf1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.162180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.163127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.163574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.163981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.185374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:10.192774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:10.193802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:10.194756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:10.199375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 104/222] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:10.204932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.206175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.206598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.207090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.208069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=2b20c03d55e94faea2b9ced8adc3dde3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:10.208547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:10.210123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f4fe-0ae2-42c8-8977-ca071f3027e9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:10.214671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.227887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 119/223] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:09 2022] GET /identity/v3/role_assignments?user.id=2b20c03d55e94faea2b9ced8adc3dde3&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:10.311615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f07-e437-4355-90fe-46b4e1e96add None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.311819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f07-e437-4355-90fe-46b4e1e96add None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.312107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f07-e437-4355-90fe-46b4e1e96add None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.318380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 120/224] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:10.320215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.320535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.320818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.333719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0723e2-413c-4e1a-b3c3-fcdbfa46d842 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.360165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.361967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:10.363185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:10.373819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.374716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.375141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.375554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.377331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:10.377949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:10.379551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:10.389480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 105/225] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:10.395874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.486762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 121/226] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:10.504015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40b468a-35d5-4703-89d4-47ae48783b4a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.511445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.531748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.539092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.540021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.540313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.540597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.542281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:10.544047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:10.546078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 106/227] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:10.551680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.612714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.660239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356fb89e-0d19-4f94-b51f-c58210a8cb6e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.668868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4bf8f2-580a-4ad5-87c4-e30588ffc8d4 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.699932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.700612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.700891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.701162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.702511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:10.704000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:10.706335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 107/228] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:10.712318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.744685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.745685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.746074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.746359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.761933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:10.767506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:10.768428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:10.769631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 122/229] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:10.774664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.867453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.903895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cc6df-b8e4-4844-82ca-4888b0573dcc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.906267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f504964-8bb5-4ed6-9ed8-eee77017cd8a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:10.942923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:10.962390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.963372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.964115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.964611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.965558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:10.966100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:10.967732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:10.977507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 123/230] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:10.982970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:10.989256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:10.990198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:10.990776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:10.992732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/e31de7d4f6754819acbe341303cc06ee/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:10.999246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, user_id=e31de7d4f6754819acbe341303cc06ee, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:11.000980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:11.023845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 108/231] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:10 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/e31de7d4f6754819acbe341303cc06ee/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:39:11.113261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021a75f-204f-4c9f-97e2-67e487a76d95 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:11.161677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:11.162357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:11.162640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:11.162916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:11.164315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:11.165854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:11.167821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 124/232] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:10 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:11.174283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:11.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd9bc0-51ac-48a9-96e0-2698b3a54f8c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:11.341725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:11.342455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:11.342650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:11.342929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:11.344152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:11.346321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1298c5d-6840-450a-9e8f-60e5e2a88097 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:11.352420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 109/233] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:11 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:11.354151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:11.374927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:11.518401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac982d-d794-416c-a411-53537ae68220 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:11.567912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:11.568642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:11.568929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:11.569210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/e31de7d4f6754819acbe341303cc06ee/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:11.577072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, user_id=e31de7d4f6754819acbe341303cc06ee, role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:11.578550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f449e-7a04-4f6a-8241-3c9111646719 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:11.614132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 125/234] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:11 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/e31de7d4f6754819acbe341303cc06ee/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:11.902573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cdbd-4807-4d14-a52c-f1285463b579 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:11.903286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cdbd-4807-4d14-a52c-f1285463b579 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:11.903790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013cdbd-4807-4d14-a52c-f1285463b579 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:11.905430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 110/235] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:11.911445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:11.912441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:11.912938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:11.936371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:11.937566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:12.020773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:12.030772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 126/236] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:12.071753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013cdbd-4807-4d14-a52c-f1285463b579 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.151118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:12.233091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013cdbd-4807-4d14-a52c-f1285463b579 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:12.281002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:12.281668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.282116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.282394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.296026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b7074475-53ad-4df6-93d0-47bdfb768913 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:12.302068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:12.302921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:12.303691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 111/237] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:12.310429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.329631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7fcb-8a97-48d9-a374-3fd1c4688844 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.329943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7fcb-8a97-48d9-a374-3fd1c4688844 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.330180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b7fcb-8a97-48d9-a374-3fd1c4688844 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.331566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 112/238] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:12.336649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.336933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.337216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.355655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:12.356862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:12.451657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e5315-3c37-40b0-87c5-ac2785dacc88 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:12.501784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 113/239] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:12.521865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:12.522511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.522855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.523132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.523918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:12.524229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:12.525643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:12.543200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 127/240] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:12.550162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.579571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.621460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:12.698696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5ce8c-5665-44b4-a706-a6bb7700c4c3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:12.722240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:12.753335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:12.754310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.756621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.757048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] PATH_INFO: `/v3/users/f23c6396937149ed9b5920f7ff409993` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.793628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] RBAC: Authorizing `identity:get_user(user_id=f23c6396937149ed9b5920f7ff409993)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:12.795138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7d4fa-b23f-4062-bee5-6ca2ca4f573e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:12.796925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 114/241] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:12 2022] GET /identity/v3/users/f23c6396937149ed9b5920f7ff409993 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:12.799791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3065-56ba-4a7b-bbd2-d41cd64a1305 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:12.803031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1002f0-c292-4c6d-8657-cad7cbd9dc78 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.803318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1002f0-c292-4c6d-8657-cad7cbd9dc78 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.803591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1002f0-c292-4c6d-8657-cad7cbd9dc78 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.805055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 115/242] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:12.805629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1002f0-c292-4c6d-8657-cad7cbd9dc78 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.843330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:12.844962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.845703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.845991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.847242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:12.848998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934dbddc-8f0d-41c4-8070-dcf48fb6daaf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:12.856729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 128/243] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:12.857865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.858150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.858427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:12.876119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:12.877358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:12.928632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:12.937856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1002f0-c292-4c6d-8657-cad7cbd9dc78 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:12.948796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 129/244] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:12.954743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:12.979292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:12.980259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:12.980709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:12.981517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.036689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:13.072325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.074761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.083702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b00c-392e-4d9a-a5f8-e69cd63b2e61 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.119671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.120318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.120781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.121068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.122547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.124019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.156700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 130/245] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:12 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:13.158193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.224195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:13.245102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 116/246] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:13.265382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.298950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec0d6-10bf-43b4-971d-e09f7263c101 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.316642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:13.342264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.342940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.343225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.343508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.357818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:13.364118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:13.365195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:13.365970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 131/247] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:13.377523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.454618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695ab17-09d4-4e35-9963-797cb6d3f466 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.498210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c259004e-737f-49ea-b982-0532c603202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.498985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259004e-737f-49ea-b982-0532c603202f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.499323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259004e-737f-49ea-b982-0532c603202f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.499675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c259004e-737f-49ea-b982-0532c603202f None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.501503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259004e-737f-49ea-b982-0532c603202f None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.503060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c259004e-737f-49ea-b982-0532c603202f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.504974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 117/248] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:13.505951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26985e6-7244-4ada-be0a-0b493da5627d None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.506232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26985e6-7244-4ada-be0a-0b493da5627d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.506599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26985e6-7244-4ada-be0a-0b493da5627d None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.508155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 118/249] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:13.510753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28051156-bf1f-4ad2-86f7-4fdd4a06ebac None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.513761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.514053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.514330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.538223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:13.539511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:13.561230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.562447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.562740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.563073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.565107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:13.565107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.566556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.576951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 132/250] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:13.577994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.614482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:13.620743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:13.626482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 119/251] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:13.632373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.717345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b8b7-6b8d-443b-aea4-8e15b5f6e91c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.755887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.756860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.757322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.757810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.758424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b665f9-cd69-4e92-bc34-7c32c0eac283 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:13.758986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=f23c6396937149ed9b5920f7ff409993) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:13.759490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.761168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.767632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 133/252] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/role_assignments?user.id=f23c6396937149ed9b5920f7ff409993&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:13.768803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.834463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:13.836058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:13.836885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:13.837625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] PATH_INFO: `/v3/users/2b20c03d55e94faea2b9ced8adc3dde3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:13.840124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] RBAC: Authorizing `identity:get_user(user_id=2b20c03d55e94faea2b9ced8adc3dde3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:13.842533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:13.844881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 120/253] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/users/2b20c03d55e94faea2b9ced8adc3dde3 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:13.857345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:13.993588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.002705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18cc90-0992-468f-bde6-7bdb929874aa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.003283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.078152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.078840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.079123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.079396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.094829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582dda4-9b18-4f53-b81d-8b05d1591211 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.100944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:14.106883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:14.107810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:14.108673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 134/254] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:14.116155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:14.171577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.172238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.173148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.173466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.177771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:14.179237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:14.184022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 121/255] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:13 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:14.189777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:14.291741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff8018-d195-4052-b3ef-387e229328a4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.339480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.340503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.341018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.342046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.342980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:14.343950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:14.346383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61448b-7822-400d-bb90-8d85d0a89b2e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:14.357910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 135/256] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:14.360980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbda9e-c4af-40e8-91b9-7ce3ce53b8c2 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.361488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbda9e-c4af-40e8-91b9-7ce3ce53b8c2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.362215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfbda9e-c4af-40e8-91b9-7ce3ce53b8c2 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.364450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 136/257] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:14.365667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbda9e-c4af-40e8-91b9-7ce3ce53b8c2 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:14.375537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429d7f9-7ce8-42f8-974d-b804761d1968 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.399003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.441995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.457127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.457860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.458142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.458414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/2b20c03d55e94faea2b9ced8adc3dde3/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.463091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, user_id=2b20c03d55e94faea2b9ced8adc3dde3, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:14.464982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a060ef-211e-4018-b7d1-f8b43ee689c2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:14.492590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfbda9e-c4af-40e8-91b9-7ce3ce53b8c2 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.494943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 122/258] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:14 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/2b20c03d55e94faea2b9ced8adc3dde3/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:14.496361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.496649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.496978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.533724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:14.534743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.534975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:14.535920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.536447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.536932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.538776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:14.540498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:14.543445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 137/259] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:14 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:14.550316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:14.666161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 123/260] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:14.693419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:14.712661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.730649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b87305-6e3d-468f-930d-41a382367eb0 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.798762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.799393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.799675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.799949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.850409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030a616-74aa-462d-adf1-f06ac09b8e86 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:14.875117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:14.909750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:14.910415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:14.910744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:14.911022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:14.932688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:14.936568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:14.939794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:14.948021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:14.948988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:14.949777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 124/261] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:14.956691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:15.106290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:15.127658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 138/262] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:39:15.146246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:15.166473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baa0f6-6ef3-4439-ad7b-f64d63103c75 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:15.269123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:15.269686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:15.269972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:15.270249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:15.270989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:15.271294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:15.272799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:15.290230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 125/263] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:15.299726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:15.342979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6782db-79a3-4197-a7c3-20c4c468c333 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:15.396807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:15.397455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:15.397732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:15.398008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:15.399172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:15.400632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:15.402432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 139/264] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:15 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:15.408912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:15.415580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:15.474398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:15.512515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf1ae5-e166-4b9e-bba0-44162fc55b40 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:15.520979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932055b-03a8-43af-9587-5d752cd30b86 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:15.568116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:15.569047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:15.569516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:15.569935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:15.570898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=e31de7d4f6754819acbe341303cc06ee) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:15.571365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:15.573158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:15.580048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 140/265] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:15 2022] GET /identity/v3/role_assignments?user.id=e31de7d4f6754819acbe341303cc06ee&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:15.588619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:15.589558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:15.589841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:15.590112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] PATH_INFO: `/v3/users/e31de7d4f6754819acbe341303cc06ee` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:15.593853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] RBAC: Authorizing `identity:get_user(user_id=e31de7d4f6754819acbe341303cc06ee)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:15.595919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:15.597803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 126/266] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:15 2022] GET /identity/v3/users/e31de7d4f6754819acbe341303cc06ee => generated 283 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:15.603785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:15.727136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8b907-1209-490e-a83f-9bf5526b53c9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:15.753322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:15.767747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:15.768753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:15.769208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:15.769625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:15.845841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:15.851746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217c8f1-592a-4f4e-865c-007408754d28 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:15.960387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 141/267] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:15.968312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.101552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3322-786f-4423-884c-dbb4e4569918 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.117653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.122852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abee05-47d2-48e0-b60c-661acb1c1e7c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.123713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abee05-47d2-48e0-b60c-661acb1c1e7c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.124210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abee05-47d2-48e0-b60c-661acb1c1e7c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.127926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 142/268] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:16.133479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.134130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.134602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.157766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:16.159111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:16.170426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.171090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.171372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.171651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.173323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:16.174783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:16.176485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 127/269] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:15 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:16.179481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.182336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.238649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 143/270] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:16.264983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.353995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b430c-00a6-42e6-9b83-0c0cea07cb25 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.377470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb63bb-8e8d-41a9-9fb3-7a9df0ddc756 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.391733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.392700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.393187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.393663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.394664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=e31de7d4f6754819acbe341303cc06ee) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:16.395234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:16.396912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:16.403646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 128/271] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/role_assignments?user.id=e31de7d4f6754819acbe341303cc06ee&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:16.418205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.418933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.419267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.419659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.432641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-d814617e-209c-48b4-81c9-19abd3fdda3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:16.437841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:16.438814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:16.439596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 144/272] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:16.444997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.493490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.520090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5d0c-be69-4296-929c-f3330db2482d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.520511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5d0c-be69-4296-929c-f3330db2482d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.520799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5d0c-be69-4296-929c-f3330db2482d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.522424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 145/273] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:16.528666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.529047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.529435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.555870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:16.557145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:16.565894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.602741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e80d96-a201-49a0-95b8-ce83a9acd6ed None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.638093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.638718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.638993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.639264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.639980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:16.640363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 146/274] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:16.644339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:16.645802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:16.654967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 129/275] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:16.660966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.677479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.776240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdda72-bdb5-4063-9ca2-f2bc95df8c2e None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.783852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9247-24a3-4702-8f94-79dfbb8f1a5b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:16.786303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.821263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.822172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.822298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:16.822494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.822725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] PATH_INFO: `/v3/users/6a826114b38740dd870326d5af3b21e4` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.822877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.823128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.823402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.824576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:16.826024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c03295-6714-4826-86df-d9fa337ec9d7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:16.827763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 130/276] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:16.830025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c392df-8ae8-4566-bb05-5af88b60d217 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.830305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c392df-8ae8-4566-bb05-5af88b60d217 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.830578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c392df-8ae8-4566-bb05-5af88b60d217 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.831986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 131/277] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:16.838310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c392df-8ae8-4566-bb05-5af88b60d217 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.840821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:16.843660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] RBAC: Authorizing `identity:get_user(user_id=6a826114b38740dd870326d5af3b21e4)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:16.846253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d972c8bf-81b4-43e9-952b-7b46b8cb2b1b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:16.848127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 147/278] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/users/6a826114b38740dd870326d5af3b21e4 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:16.852335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463e87-c395-40ac-9229-953647efb6bd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:16.852335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463e87-c395-40ac-9229-953647efb6bd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:16.852335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83463e87-c395-40ac-9229-953647efb6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:16.871346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-83463e87-c395-40ac-9229-953647efb6bd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:16.871544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-83463e87-c395-40ac-9229-953647efb6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:16.949217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 148/279] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:16.949982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83463e87-c395-40ac-9229-953647efb6bd None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:16.968149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c392df-8ae8-4566-bb05-5af88b60d217 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.004906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.005521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.005796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.006065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.006747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:17.008180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:17.031667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 132/280] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:16 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:39:17.031667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.067063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:17.077726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83463e87-c395-40ac-9229-953647efb6bd None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.117566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:17.124466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.128790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.128790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.128790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.128790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, user.id=6a826114b38740dd870326d5af3b21e4, scope.system=all) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:17.128790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:17.130009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:17.137258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 149/281] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Jul 25 22:39:16 2022] GET /identity/v3/role_assignments?user.id=6a826114b38740dd870326d5af3b21e4&scope.system=all&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:17.161877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c18b-702b-4be0-a894-0502c6389191 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.203084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.204252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.204564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.204839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.217462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:17.223169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:17.224102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:17.224903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 133/282] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:17.231249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.351714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40728e86-c295-4a22-aef6-f1ea4ce6c11b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.388734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.389364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.389640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.389912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.390750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:17.391093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:17.392483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60319b-dcce-4010-ab7f-334ebc1d8fbe None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:17.404872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 150/283] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:17.407721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.478581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3db7d-1123-47a6-9d7d-49aa161e508a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.479083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3db7d-1123-47a6-9d7d-49aa161e508a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.479523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3db7d-1123-47a6-9d7d-49aa161e508a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.481083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 151/284] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:17.487028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058840-63ea-477d-8281-da6f06282768 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.487305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058840-63ea-477d-8281-da6f06282768 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.487580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46058840-63ea-477d-8281-da6f06282768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.509502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-46058840-63ea-477d-8281-da6f06282768 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:17.510690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-46058840-63ea-477d-8281-da6f06282768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:17.526566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:17.548764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7120b36c-769a-4420-aa94-43e10e678f8c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.602366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.603558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.604665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:17.604963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.605437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] PATH_INFO: `/v3/users/f23c6396937149ed9b5920f7ff409993` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.606868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] RBAC: Authorizing `identity:get_user(user_id=f23c6396937149ed9b5920f7ff409993)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:17.608577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:17.611846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 134/285] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/users/f23c6396937149ed9b5920f7ff409993 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:17.618053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.635690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 152/286] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:17.674327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058840-63ea-477d-8281-da6f06282768 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.781203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4404d-95ed-497b-831e-f18eee95b15a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.856809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46058840-63ea-477d-8281-da6f06282768 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:17.869305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.869988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.870366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.870667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.877532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:17.880374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:17.884057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 135/287] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:17.897245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.901547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:17.902462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:17.902969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:17.903440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:17.914852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:17.920232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:17.921116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:17.921916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:17.924547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 153/288] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:17.930262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:17.965675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:17.986580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:18.059093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2a455-6146-4476-9f7f-12d70969f7ce None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:18.117965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa69bbd-d5bb-4af9-8fd8-57fcea393a1d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:18.162500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:18.163524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:18.164003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:18.164528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/f23c6396937149ed9b5920f7ff409993/roles/d89da1c8c54e4d498d049714e4904dfb` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:18.166816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, user_id=f23c6396937149ed9b5920f7ff409993, role_id=d89da1c8c54e4d498d049714e4904dfb)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:18.168665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:18.183621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 136/289] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:17 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/users/f23c6396937149ed9b5920f7ff409993/roles/d89da1c8c54e4d498d049714e4904dfb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:18.205704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:18.206344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:18.206621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:18.206896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:18.207634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:18.207939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:18.209370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:18.227025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 154/290] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:18.232956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:18.355228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:18.375195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855956ba-822b-4440-b0f4-d3148e6ef5fe None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:18.413507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:18.414566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:18.415043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:18.415509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] PATH_INFO: `/v3/users/2b20c03d55e94faea2b9ced8adc3dde3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:18.416929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] RBAC: Authorizing `identity:get_user(user_id=2b20c03d55e94faea2b9ced8adc3dde3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:18.418613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:18.420792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 137/291] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:18 2022] GET /identity/v3/users/2b20c03d55e94faea2b9ced8adc3dde3 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:18.427288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:18.578232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741376b0-6f6d-4682-9bbe-ac2f11535b76 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:18.591145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:18.626628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:18.627266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:18.627549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:18.627830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:18.698974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:18.700470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:18.811913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 155/292] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:18.817366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:18.950196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfed715-8aa2-4bf4-a3a2-d07e19f2af0b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:18.995382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:18.996468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:18.996950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:18.997422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:18.998847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:19.000550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab86b7-0e15-4c21-9f05-d31656fc1a27 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:19.002446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 138/293] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:18 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:19.008352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.030604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:19.159686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865735b-9878-45e9-8247-9772bb9faad1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:19.206668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:19.208078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.208578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.209047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.210039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=2b20c03d55e94faea2b9ced8adc3dde3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:19.210580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:19.212204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097a682-2edc-4618-b090-4fcf08b701ac None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:19.223040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 156/294] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:19 2022] GET /identity/v3/role_assignments?user.id=2b20c03d55e94faea2b9ced8adc3dde3&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:19.345989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e693-d8f8-4dab-88ba-2315f42c9ddf None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.346624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e693-d8f8-4dab-88ba-2315f42c9ddf None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.347126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5e693-d8f8-4dab-88ba-2315f42c9ddf None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.349091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 139/295] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:19.354269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250394-11b1-4fd6-822f-da0de71a26b9 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.354541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250394-11b1-4fd6-822f-da0de71a26b9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.354823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f250394-11b1-4fd6-822f-da0de71a26b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.381254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-7f250394-11b1-4fd6-822f-da0de71a26b9 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:19.382483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7f250394-11b1-4fd6-822f-da0de71a26b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:19.469810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 157/296] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:19.491989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e693-d8f8-4dab-88ba-2315f42c9ddf None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.518437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:19.592871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ea2-882e-4262-a7e5-779777a03fb7 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.593570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ea2-882e-4262-a7e5-779777a03fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.594078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ea2-882e-4262-a7e5-779777a03fb7 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.595908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 158/297] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:19.600796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.601343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.601816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.615928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5e693-d8f8-4dab-88ba-2315f42c9ddf None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:19.616791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:19.631917 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:19.633202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:19.657665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:19.658327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.658611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.658885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.672869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:19.679510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:19.680441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:19.681237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 140/298] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:19.686204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.732175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 159/299] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:19.755741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.777643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:19.798250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2153649-252e-4afb-9947-e72febfc9b65 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:19.833277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:19.834014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.834208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.834482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.835253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:19.835560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:19.836997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:19.846502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 141/300] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:19.851952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.866770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f6b27-76fc-4b86-af99-050dff20508a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:19.909335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:19.916461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:19.917222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.917508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.917889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.919065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:19.920547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:19.927507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 160/301] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:19.928823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:19.958754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046874a-6271-4060-9cc4-e988a7c6c0ec None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:19.994921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:19.995487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:19.995768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:19.996043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] PATH_INFO: `/v3/users/6a826114b38740dd870326d5af3b21e4` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:19.997299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] RBAC: Authorizing `identity:get_user(user_id=6a826114b38740dd870326d5af3b21e4)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:19.998838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505bd4e-a7bc-4ad2-835a-5e641520cda4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:20.005246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 142/302] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:19 2022] GET /identity/v3/users/6a826114b38740dd870326d5af3b21e4 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:20.006466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5c54-3cbb-4784-ba42-19da74ac3301 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.006706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5c54-3cbb-4784-ba42-19da74ac3301 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.006982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5c54-3cbb-4784-ba42-19da74ac3301 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.008409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 143/303] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:20.010549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5c54-3cbb-4784-ba42-19da74ac3301 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.022369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:20.039384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb3860-99f1-454d-93dd-c22f42ffd597 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.078774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.079404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.079688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.079968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] PATH_INFO: `/v3/groups` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.080670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:20.082109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc88eb-a9b2-4bd4-a1d4-457e9e632746 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:20.098759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 161/304] 10.222.0.59 () {60 vars in 1134 bytes} [Mon Jul 25 22:39:19 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:39:20.110407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.110745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.110974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.125281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5c54-3cbb-4784-ba42-19da74ac3301 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.153736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:20.155967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:20.167078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.167791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.168070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.168369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] PATH_INFO: `/v3/system/users/6a826114b38740dd870326d5af3b21e4/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.169892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a826114b38740dd870326d5af3b21e4, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:20.171303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:20.185452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 144/305] 10.222.0.59 () {58 vars in 1334 bytes} [Mon Jul 25 22:39:20 2022] PUT /identity/v3/system/users/6a826114b38740dd870326d5af3b21e4/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:20.235421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:20.253949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 162/306] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:20.277221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.367060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:20.395155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddcfce-bf63-46cb-a1a8-274b058d1caf None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.430133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.430775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.431055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.431325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.441470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:20.447051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:20.447921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:20.448893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 145/307] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:20.456694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.560276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92477a7-859e-49ac-8d59-72b8b108b8d1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.595720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.596395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.596676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.596950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.597739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:20.598048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:20.599469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415773c1-f702-41d7-8f8f-59ccf7476609 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:20.608366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 163/308] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:20.617418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.628021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6b6d-52ee-4e66-b320-9c20505cfed9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.628336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6b6d-52ee-4e66-b320-9c20505cfed9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.628619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d6b6d-52ee-4e66-b320-9c20505cfed9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.630212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 164/309] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:20.635071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.635355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.635633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.654772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:20.656196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:20.711763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:20.735126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 165/310] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:20.748525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e03624-acb7-44e4-b2b1-4624bcf1b92b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.761872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.792698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.793446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.793733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.794009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] PATH_INFO: `/v3/users/4bea22a3ce1541eaa743a93a3530edc1` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.796621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:20.811397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] RBAC: Authorizing `identity:get_user(user_id=4bea22a3ce1541eaa743a93a3530edc1)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:20.813906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:20.816182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 146/311] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/users/4bea22a3ce1541eaa743a93a3530edc1 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:20.821780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.883473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6b007-7a72-453f-869d-ffbcf7fb2db7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.935912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.936601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.936883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.937159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.942204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f798b1-773d-4635-b8ad-5d58b323a411 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:20.951749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:20.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:20.960276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:20.961088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 166/312] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:20.966710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:20.990919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:20.991792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:20.992215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:20.992649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:20.993742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, user.id=4bea22a3ce1541eaa743a93a3530edc1, scope.system=all) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:20.994237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:20.995891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.002310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 147/313] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/role_assignments?user.id=4bea22a3ce1541eaa743a93a3530edc1&scope.system=all&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:21.015242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:21.081488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078cef2-041a-4e6f-8640-e7f7e95be8e5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:21.119411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:21.120047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:21.120389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:21.120666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:21.121408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:21.121710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:21.123115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.138635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 167/314] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:21.139668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:21.203987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:21.251675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c633b3-6959-445a-be63-2d2af7c58df7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:21.286881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:21.287522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:21.287796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:21.288067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] PATH_INFO: `/v3/users/f23c6396937149ed9b5920f7ff409993` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:21.289301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] RBAC: Authorizing `identity:get_user(user_id=f23c6396937149ed9b5920f7ff409993)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:21.290753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.292501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 148/315] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:21 2022] GET /identity/v3/users/f23c6396937149ed9b5920f7ff409993 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:21.298606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:21.407259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fa39-82cb-419b-909a-1156459fc31f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:21.410077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:21.446891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:21.447570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:21.447852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:21.448125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:21.522658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:21.524124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.638305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 168/316] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:21.643929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:21.752272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4712100-015c-47ab-9ce4-5d8bd72125ae None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:21.781011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:21.793641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:21.794672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:21.795161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:21.795706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:21.797185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:21.798920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56156b37-5d31-4e9a-b2d0-42f453316412 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.800883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 149/317] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:21 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:21.810380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:21.813590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:21.948791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa58a0a-c86b-4022-8f83-24ce693684ff None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:21.986387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:21.987011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:21.987283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:21.987560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:21.988437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf, user.id=f23c6396937149ed9b5920f7ff409993) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:21.988798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:21.990253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58a082-cc95-43f2-8a7f-6bd5d10aa3f3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:21.996725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 169/318] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:21 2022] GET /identity/v3/role_assignments?user.id=f23c6396937149ed9b5920f7ff409993&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:22.351945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34dd3-9207-4ad3-8cb7-935cbf867c94 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.352549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34dd3-9207-4ad3-8cb7-935cbf867c94 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.352815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b34dd3-9207-4ad3-8cb7-935cbf867c94 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.354294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 150/319] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:22.359391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90291-5c8e-4e3f-bf4b-2a478076eeaf None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.359821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90291-5c8e-4e3f-bf4b-2a478076eeaf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.360004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90291-5c8e-4e3f-bf4b-2a478076eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.379139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-dae90291-5c8e-4e3f-bf4b-2a478076eeaf None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:22.380437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-dae90291-5c8e-4e3f-bf4b-2a478076eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:22.443178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:22.449173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 170/320] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:22.460234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6491-d8f3-408f-ac46-f6decb3b3c0f None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.460639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6491-d8f3-408f-ac46-f6decb3b3c0f None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.460977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6491-d8f3-408f-ac46-f6decb3b3c0f None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.462398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 151/321] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:22.467565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.467857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.468137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.472086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6491-d8f3-408f-ac46-f6decb3b3c0f None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:22.489917 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:22.491101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:22.576541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 171/322] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:22.587538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6491-d8f3-408f-ac46-f6decb3b3c0f None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:22.598256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:22.631476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:22.632306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.632595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.633701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.645284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:22.650446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:22.651379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:22.652178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 152/323] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:22.657458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:22.704092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928be68d-5802-4a18-802f-a9b1a70cf44a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:22.713320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:22.735090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:22.743673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:22.744365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.744855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.744974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.746310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:22.747769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:22.749581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 172/324] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:22.755572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:22.765157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137f6fb-c7d3-4ac4-8bb3-8c89c49fe286 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:22.799871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:22.800521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.800801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.801077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.801805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:22.802108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:22.803489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:22.811761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 153/325] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:22.817737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:22.868592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d759b-4eea-47d0-bf84-9aa387b9b806 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:22.907546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:22.908087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.908399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.908679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] PATH_INFO: `/v3/groups` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.909346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:22.910797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:22.927978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 173/326] 10.222.0.59 () {60 vars in 1134 bytes} [Mon Jul 25 22:39:22 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:39:22.939283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf315131-2646-4dd4-8789-a7758531b4b6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:22.955521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:22.979085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:22.979819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:22.980103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:22.980413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] PATH_INFO: `/v3/users/6a826114b38740dd870326d5af3b21e4` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:22.981737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] RBAC: Authorizing `identity:get_user(user_id=6a826114b38740dd870326d5af3b21e4)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:22.983283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4df24b-6cfe-4ee2-a5fb-da8024f187e6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:22.985802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 154/327] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:22 2022] GET /identity/v3/users/6a826114b38740dd870326d5af3b21e4 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:22.991721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:23.054384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:23.105643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f0ad0-1891-430d-b8ff-4b90260502bd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:23.146152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:23.146788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.147074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.147353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.148159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] RBAC: Adding query filter params (role.id=14635753bbaa46bfb5475d51ad0b91a5, user.id=6a826114b38740dd870326d5af3b21e4, scope.system=all) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:23.148504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:23.149954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348093f-aca5-4e36-9c0d-9f101c602da7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:23.163455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 174/328] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Jul 25 22:39:22 2022] GET /identity/v3/role_assignments?user.id=6a826114b38740dd870326d5af3b21e4&scope.system=all&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:23.183593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f7f0-31d5-441b-9e4f-7132be86efb9 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.183811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f7f0-31d5-441b-9e4f-7132be86efb9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.184094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790f7f0-31d5-441b-9e4f-7132be86efb9 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.185806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 155/329] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:23.192167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.192480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.192757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.214893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:23.216113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:23.293168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 175/330] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:23.316722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790f7f0-31d5-441b-9e4f-7132be86efb9 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:23.430732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790f7f0-31d5-441b-9e4f-7132be86efb9 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:23.466392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:23.467035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.467313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.467585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.478448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:23.483992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:23.485473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:23.487053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 156/331] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:23.491633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:23.540842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:23.600265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf9271-b532-4018-8a3e-80dd74f4af94 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:23.639819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:23.640870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.641372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.641863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.642795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:23.643306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:23.644908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:23.658510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 176/332] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:23.664219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:23.714492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:23.778114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a16eab-1b0e-41f0-8f8d-5472c95daeea None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:23.818339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:23.819005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:23.819283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:23.819557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] PATH_INFO: `/v3/users/4bea22a3ce1541eaa743a93a3530edc1` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:23.822698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] RBAC: Authorizing `identity:get_user(user_id=4bea22a3ce1541eaa743a93a3530edc1)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:23.824173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec658eb7-434b-4e90-9d46-323b973560bf None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:23.826234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 157/333] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:23 2022] GET /identity/v3/users/4bea22a3ce1541eaa743a93a3530edc1 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:23.831579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:23.966837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f32f2-dc11-49e0-b2f3-452318609e08 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:23.977680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:24.007573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:24.008250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:24.008611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:24.008890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] PATH_INFO: `/v3/system/users/4bea22a3ce1541eaa743a93a3530edc1/roles/d89da1c8c54e4d498d049714e4904dfb` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:24.010360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4bea22a3ce1541eaa743a93a3530edc1, role_id=d89da1c8c54e4d498d049714e4904dfb)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:24.011733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daab0e-8b31-4601-b71a-bc4e93609b13 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:24.025724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 177/334] 10.222.0.59 () {58 vars in 1334 bytes} [Mon Jul 25 22:39:23 2022] PUT /identity/v3/system/users/4bea22a3ce1541eaa743a93a3530edc1/roles/d89da1c8c54e4d498d049714e4904dfb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:25.204901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813650-6ce6-42fb-8c32-754036b6981e None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.205409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813650-6ce6-42fb-8c32-754036b6981e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.205482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45813650-6ce6-42fb-8c32-754036b6981e None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.207086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 158/335] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:25.212192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080b01-0baf-4cf5-9ca3-a0f8ca6dff60 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.212602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080b01-0baf-4cf5-9ca3-a0f8ca6dff60 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.212796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86080b01-0baf-4cf5-9ca3-a0f8ca6dff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.241534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-86080b01-0baf-4cf5-9ca3-a0f8ca6dff60 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:25.242733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-86080b01-0baf-4cf5-9ca3-a0f8ca6dff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:25.333854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 178/336] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:25.377589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45813650-6ce6-42fb-8c32-754036b6981e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:25.490138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75bdd-528e-4ee7-a729-821c94c05f83 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.490441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75bdd-528e-4ee7-a729-821c94c05f83 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.490619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f75bdd-528e-4ee7-a729-821c94c05f83 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.492741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 179/337] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:25.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503122-c236-4052-b9ba-4183c348453c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.499435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503122-c236-4052-b9ba-4183c348453c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.499714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503122-c236-4052-b9ba-4183c348453c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.535451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6d503122-c236-4052-b9ba-4183c348453c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:25.536682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6d503122-c236-4052-b9ba-4183c348453c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:25.541339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45813650-6ce6-42fb-8c32-754036b6981e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:25.557913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:25.613876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:25.614542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.614816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.615090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.637707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:25.644123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:25.645022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:25.645789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:25.646850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 159/338] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:25.656793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:25.682896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 180/339] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:25.725753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503122-c236-4052-b9ba-4183c348453c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:25.766982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:25.830324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eda756-ee57-468d-8ba0-4eff11f6f740 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:25.882361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:25.882701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503122-c236-4052-b9ba-4183c348453c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:25.883030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.883309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.883583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.884330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:25.884635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:25.886105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:25.899573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 160/340] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:25.905220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:25.949981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:25.950661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:25.950944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:25.951219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:25.951687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:25.989281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:25.994363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:25.995225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:25.996018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 181/341] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:26.010530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.057537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4845c-4f43-43b0-a602-52930f226f71 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.119965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.120975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.121451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.121930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.227878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:26.229423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:26.247198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.279085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f4fc3-008a-4f8d-bfbc-1dc771674dcf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.303801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.362751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 161/342] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:39:26.368827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.380942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.381641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.381920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.382191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.382971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:26.383276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:26.384783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:26.400053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 182/343] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:26.413764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.510874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b56774-212f-4c6a-a1dd-4341b6721aee None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.539755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b778d-0d8d-4c99-87e5-2c1bfce894a3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.543977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.550345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.551259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.551683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.552100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.553498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:26.555127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb51e79-2011-405d-b1d5-a0bd16c424c3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:26.557306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 162/344] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:26.558622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655bc2-c19a-40ed-8398-7b0da7a679c4 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.559047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655bc2-c19a-40ed-8398-7b0da7a679c4 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.559471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a655bc2-c19a-40ed-8398-7b0da7a679c4 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.565244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 163/345] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:26.570734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.571221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.571642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.579720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.580483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.580771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.581045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.593049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:26.594471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:26.605234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.661340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:26.663382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:26.668038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 164/346] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:26.669133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.796189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 183/347] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:39:26.798022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.829896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a4d30-8c8a-49fa-8804-bd32c93584d6 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.864327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.869345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:26.872107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34408-9267-4589-b355-9990217b301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.873009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34408-9267-4589-b355-9990217b301e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.873469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34408-9267-4589-b355-9990217b301e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.873957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34408-9267-4589-b355-9990217b301e None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.881941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34408-9267-4589-b355-9990217b301e None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:26.883400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34408-9267-4589-b355-9990217b301e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:26.888451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 165/348] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:26.888451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34408-9267-4589-b355-9990217b301e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:26.945958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e621f-0a64-4d95-9d7b-9e7cce5f1ffd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:26.993614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:26.994611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:26.995072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:26.995537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:26.999568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34408-9267-4589-b355-9990217b301e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.018575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3525f99c-3cab-4a4d-817d-070a938191df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:27.024182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:27.026379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:27.027378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:27.030185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 184/349] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:27.032580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7fe5-96c3-4358-894a-f3b3ef39f305 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.033121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7fe5-96c3-4358-894a-f3b3ef39f305 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.033630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b7fe5-96c3-4358-894a-f3b3ef39f305 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.035398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.035965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 185/350] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:27.036077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.036333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.036599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.037358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7fe5-96c3-4358-894a-f3b3ef39f305 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.042355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.044061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.046074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 166/351] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:26 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.047045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.138913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.182754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d052f-360f-47aa-88f6-0e526933158a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.201067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b7fe5-96c3-4358-894a-f3b3ef39f305 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.220015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.223632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.223632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.223867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.224027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.224751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:27.225051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.226880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53341fc4-5e81-42c4-93f4-1106470a1f0e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.238412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 167/352] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.239736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.240028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.240317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.253365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.254604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.255610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.256062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.257363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=487df376a9e74299a45758c37395c1f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:27.257869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.259487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.260628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:27.262153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:27.266470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 186/353] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.268464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.369991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 168/354] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:27.371312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.425954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b6b2-99d4-48a0-9bff-76106d8b0b12 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.459043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.479598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.480862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.481319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.481963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.484555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.486837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.489513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 187/355] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.490529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.525701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a729728-6bde-4fca-8e39-ed403cfd2398 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.564756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.572792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.574750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.574750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.574750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.636850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a583224-898b-4b68-8dec-09840d5ff127 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.652947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.654729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.685777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.686973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.687721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.688218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.703666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-ad260700-1e73-498c-bc6a-675877862710 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:27.711396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:27.712259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:27.713071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:27.713929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 188/356] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:27.715013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79693f-3712-4a03-9e8e-3bb885440e2b None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.715294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79693f-3712-4a03-9e8e-3bb885440e2b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.715566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79693f-3712-4a03-9e8e-3bb885440e2b None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.716860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 189/357] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:27.717694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79693f-3712-4a03-9e8e-3bb885440e2b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.726055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.785524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 169/358] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:27.786845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:27.847051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79693f-3712-4a03-9e8e-3bb885440e2b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.851140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:27.895699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.896371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.896659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.896932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.898119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=487df376a9e74299a45758c37395c1f2) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:27.898433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.900132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7989a01d-c44c-4291-86b7-d18e190ccbe9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.907889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 190/359] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.909258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b704a-ae05-451e-90be-1df0d779be48 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.909548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b704a-ae05-451e-90be-1df0d779be48 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.909824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b704a-ae05-451e-90be-1df0d779be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.925796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fffaf-6274-4a18-8072-fa55c494adca None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:27.941663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-344b704a-ae05-451e-90be-1df0d779be48 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:27.943271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-344b704a-ae05-451e-90be-1df0d779be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:27.978225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:27.978774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:27.979138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:27.979410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:27.980151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:27.980483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:27.981960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:27.993277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 170/360] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:27.994176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.019100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.046704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 191/361] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:28.048103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efdded-b907-464e-98eb-99b5d1c053d1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.048419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efdded-b907-464e-98eb-99b5d1c053d1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.049287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efdded-b907-464e-98eb-99b5d1c053d1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.050754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 192/362] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:28.051326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efdded-b907-464e-98eb-99b5d1c053d1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.134081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3358248-b92b-4faa-9eaf-45f88ebdfa64 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.181509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.183149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.183652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.184233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.186527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.189197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16cd0-9c31-49c3-95b8-b0ea4030e2d1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.191901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.196402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 171/363] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:27 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:28.197920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.198205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.198483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.199443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efdded-b907-464e-98eb-99b5d1c053d1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.221327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:28.222533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:28.241091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.241802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.242296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.242926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.301472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 172/364] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:28.303094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.323078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.324568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.334303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.436811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.442796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 193/365] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:28.443973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.450730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49723597-923b-4df0-9c8e-e7ba3c216494 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.491761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.492496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.492714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.492985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.505550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:28.510861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:28.511759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:28.512554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 173/366] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:28.513809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.558316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed250ab-a831-4bf5-b4ec-36e07ffff931 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.599125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.600131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.600633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.601383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.601648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.603065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.605174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.607274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 194/367] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:28.608453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.634494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b66f2f-0ade-442d-96f1-5448c6da1ef4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.672629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.673132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.673412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.673685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.684618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.685551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:28.691549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:28.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:28.693245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 174/368] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:28.693913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.727504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb482a-6082-4bcf-ab3b-ba849f95e011 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.767370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.768072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.768393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.768678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.769905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.771516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.773549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 195/369] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:28.774129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.805195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94debc9f-fff1-484a-9265-6482ac53c927 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.845883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.846512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.846791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.847062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.847793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:28.848097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.849530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.851054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:28.868709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 175/370] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:28.869938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.888445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ababa93-b34b-47ac-9f42-e5a33938f4c5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:28.927534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:28.928196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:28.928520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:28.928842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:28.929635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:28.929943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:28.931571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:28.939654 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 196/371] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:28.940526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:28.944609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:29.028082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635bc67-dc30-450d-ba52-7d60e50e286d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.060982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6daf53-6fbc-4d1b-9e34-0a4cf0896bb9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.077472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.078170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.078592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.078872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.079620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:29.080103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.081935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.094661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 176/372] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.095519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.104964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.105679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.105964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.106240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.107528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.109060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.112515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 197/373] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:28 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.113308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.176025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:29.214241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:29.229966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc95796-9069-446e-bd68-741b5547d14c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.254621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e54edb-a342-4492-967c-6c3961ecf217 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.268181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.268966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.269253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.269635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] PATH_INFO: `/v3/users/4bea22a3ce1541eaa743a93a3530edc1` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.271040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] RBAC: Authorizing `identity:get_user(user_id=4bea22a3ce1541eaa743a93a3530edc1)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.272683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.274619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 177/374] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/users/4bea22a3ce1541eaa743a93a3530edc1 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.275212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.290755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.291300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.291581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.291852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.385458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.387160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.467931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a143e-bfe3-48c9-9d3b-90152e85e346 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.519121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:29.524975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:29.539568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.540193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.540495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.540825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.541569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:29.541886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.543315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.555734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 178/375] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.556619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.588973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 198/376] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:29.599825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.730376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a871f4-177e-4445-b726-9f6d10cb1011 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.788441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.789543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.789819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.790091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.790944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] RBAC: Adding query filter params (role.id=d89da1c8c54e4d498d049714e4904dfb, user.id=4bea22a3ce1541eaa743a93a3530edc1, scope.system=all) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:29.791201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.793130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.816235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 179/377] 10.222.0.59 () {56 vars in 1308 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/role_assignments?user.id=4bea22a3ce1541eaa743a93a3530edc1&scope.system=all&role.id=d89da1c8c54e4d498d049714e4904dfb => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.842768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e392a2-a1af-4e82-8aff-ceae1d42be19 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:29.900915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:29.901586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:29.901872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:29.902153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] PATH_INFO: `/v3/projects/bac6b86a78e2495dac480c2085c0033f` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:29.903359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] RBAC: Authorizing `identity:get_project(project_id=bac6b86a78e2495dac480c2085c0033f)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:29.904865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:29.906948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 199/378] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/projects/bac6b86a78e2495dac480c2085c0033f => generated 344 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:29.912463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:29.987330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:30.051459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50bad3-7bcf-4238-b03a-6fd3cfa2e218 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:30.089638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:30.090521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.090941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.091377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] PATH_INFO: `/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.096829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] RBAC: Authorizing `identity:get_group(group_id=9a7a8ccc52a54e3686eb801b8617b9df)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:30.098447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02e8b-c415-40db-9287-c680c7834b3b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:30.104593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 180/379] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:29 2022] GET /identity/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:30.106504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:30.155321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:30.225575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3721-4dc8-4022-b10e-32803f166d5e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:30.233126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7659-ca74-430d-adf5-2751d81b2212 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.233615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7659-ca74-430d-adf5-2751d81b2212 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.234589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d7659-ca74-430d-adf5-2751d81b2212 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.236187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 181/380] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:30.241732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.242192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.242604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.267532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:30.269369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:30.297632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc18d-e374-422b-9691-290b488195af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:30.298400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc18d-e374-422b-9691-290b488195af None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.298835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc18d-e374-422b-9691-290b488195af None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.299282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cc18d-e374-422b-9691-290b488195af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.300230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc18d-e374-422b-9691-290b488195af None admin] RBAC: Adding query filter params (group.id=9a7a8ccc52a54e3686eb801b8617b9df, role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=bac6b86a78e2495dac480c2085c0033f) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:30.300706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc18d-e374-422b-9691-290b488195af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:30.302463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cc18d-e374-422b-9691-290b488195af None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:30.317970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 200/381] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:30 2022] GET /identity/v3/role_assignments?group.id=9a7a8ccc52a54e3686eb801b8617b9df&scope.project.id=bac6b86a78e2495dac480c2085c0033f&role.id=e3f77a14908d48e99043f557a465098a => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:30.368693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 182/382] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:30.405835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc18d-e374-422b-9691-290b488195af None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:30.543253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:30.547897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cc18d-e374-422b-9691-290b488195af None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:30.594988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:30.595575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.595855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.596128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.607389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-4fdae73c-7b90-4659-b71e-241622e10b47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:30.613043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:30.613929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:30.614709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 201/383] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:30.620114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:30.668188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:30.722258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844bc9-a25c-4d93-8a24-6dc09ffb2dbd None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.722258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844bc9-a25c-4d93-8a24-6dc09ffb2dbd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.722258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac844bc9-a25c-4d93-8a24-6dc09ffb2dbd None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.722258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 202/384] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:30.729539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.729817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.730094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.756518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:30.758470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:30.774518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47655a1-70d1-4965-8ffd-98c101d5ff23 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:30.840972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:30.841966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:30.842504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:30.842978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:30.843935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:30.844465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:30.846099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:30.867094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 203/385] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:30.868000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 183/386] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:30.873237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:30.901541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:30.972422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:30.987581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d06b2-d7de-4035-8c26-64656fcabafb None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.023036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.023700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.023981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.024256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.025466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.026981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.028989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 204/387] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:30 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:31.035280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:31.138539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619baf8-b2df-460f-b48f-f6ffa87898c5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.175547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.176205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.176511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.176793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.177961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.179404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.181407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 205/388] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:31 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:31.187041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:31.212195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f60749-1549-48f4-8b84-acd235628a90 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.215785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:31.218491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:31.308771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99214e78-a441-4d96-8bf0-47f7c0332465 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.321898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.322927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.323408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.323874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.347648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:31.349022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.349952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.350369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.350797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/groups/88d3f388fef24efeb956ef85b8aebb26/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.352910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, group_id=88d3f388fef24efeb956ef85b8aebb26, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:31.353636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:31.354708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:31.355504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:31.356167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 184/389] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:31.357384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.365257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:31.376814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 206/390] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Jul 25 22:39:31 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/groups/88d3f388fef24efeb956ef85b8aebb26/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:39:31.522900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc87ad1-fb3e-4832-b6e8-6b5a6174e252 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.568626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.569613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.570115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.570605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.571531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:31.572033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.573646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.587926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 185/391] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:31.593648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:31.703012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:31.720391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91bd9-ca1a-4bf6-a0b3-0b31a2d04423 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.760011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.760725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.761005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.761280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.762426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.763867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86ff5a-0983-4dc9-b70a-cf3236417b7d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.765833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 207/392] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:31 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:31.771030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:31.801485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:31.882562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c9d1-3c30-4917-bf00-4aad265ae211 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:31.899110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75f98-e576-4e45-aafd-4cdd19349eff None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.899757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75f98-e576-4e45-aafd-4cdd19349eff None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.900035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b75f98-e576-4e45-aafd-4cdd19349eff None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.902031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 208/393] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:31.914942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.915771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.916719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.947090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:31.948088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:31.948565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:31.949007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:31.952100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:31.952928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:31.954918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:31.955362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:31.958242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 186/394] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:31 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:31.967725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.104093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 209/395] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:32.135492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:32.141916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.155361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f085d08-a986-42a5-a193-d2aff6b0e573 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.220589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.221648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.222134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.222609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2/groups/88d3f388fef24efeb956ef85b8aebb26/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.225028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] RBAC: Authorizing `identity:create_grant(project_id=487df376a9e74299a45758c37395c1f2, group_id=88d3f388fef24efeb956ef85b8aebb26, role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:32.226703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:32.254453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 187/396] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Jul 25 22:39:31 2022] PUT /identity/v3/projects/487df376a9e74299a45758c37395c1f2/groups/88d3f388fef24efeb956ef85b8aebb26/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:39:32.271205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:32.291745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4350-6dfc-4546-89ee-5bbafad990ce None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.334271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.334939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.335223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.335504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.347775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-839d9e55-4e57-4bb3-bf53-2899a4fdd79f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:32.352939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:32.353876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:32.354738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 210/397] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:32.362735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.386102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6120-bdbe-4a53-908f-d743567970e1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.386434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6120-bdbe-4a53-908f-d743567970e1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.386673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6120-bdbe-4a53-908f-d743567970e1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.388423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 211/398] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:32.394280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.394565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.394896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.428967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:32.433630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:32.535797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a86d1-b9aa-4329-a8b4-5279db6f3f82 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.537096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 212/399] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:32.560572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.573562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.574253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.574534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.574807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.575540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:32.575844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:32.577609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:32.587312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 188/400] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:32.593341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.621162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:32.658935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:32.696728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33101061-8a46-4f04-8347-802383b5cd51 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.735591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.736259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.736611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.736893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.742854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206b805-592b-4030-93fa-209580b00c97 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.748065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:32.754011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:32.754882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:32.755685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 213/401] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:32.761104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.821033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.821695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.821987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.822262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.823481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:32.824976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:32.826893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 189/402] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:32.831878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:32.898270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b25bf-84ac-4fe3-9d4e-fce2bbdef9aa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:32.936487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:32.942621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:32.943782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:32.944493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:32.944972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:32.946419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:32.947281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:32.949027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:32.963173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 214/403] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:32.966215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.024920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:33.056248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06290a-30b0-4e8e-8128-b079c1b85008 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.099167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.099900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.100249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.100550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.101844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.103423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5b9a2-6284-492d-892f-c8622caa0598 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.105560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 190/404] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:33.106793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30f50-5b2f-4d33-9616-63a7b50b1f13 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.108370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30f50-5b2f-4d33-9616-63a7b50b1f13 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.108740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd30f50-5b2f-4d33-9616-63a7b50b1f13 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.110432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 191/405] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:33.111029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd30f50-5b2f-4d33-9616-63a7b50b1f13 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.114220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea49ff-aa0b-4edc-b403-84cd39438885 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.159903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.161005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.161774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.162487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.164128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.167036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911f08c-9b18-4e21-a4fb-4fd1fc7462ab None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.174203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 215/406] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:32 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:33.175483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.175768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.176111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.196014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:33.197324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:33.260937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd30f50-5b2f-4d33-9616-63a7b50b1f13 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.274217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 216/407] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:33.275206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.284686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:33.304059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.305038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.305736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.306115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/groups/88d3f388fef24efeb956ef85b8aebb26/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.308658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, group_id=88d3f388fef24efeb956ef85b8aebb26, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.310534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.330537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 192/408] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Jul 25 22:39:33 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/groups/88d3f388fef24efeb956ef85b8aebb26/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:33.331494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.368990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:33.478686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766d9c-58fb-4a53-9b16-7f0fb8937ef6 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.489596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce008-8b3d-4387-b5e8-5691e75c30c1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.529250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.529902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.530187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.530468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.546510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:33.553987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:33.554873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:33.555696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 193/409] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:33.557359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.558231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.558710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.559192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.560615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.560792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.562983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.566005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 217/410] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:33 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:33.571428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.635618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:33.649135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:33.691442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83763800-5e6e-4ed1-8495-44f4f4812581 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.719186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53076ab-287c-4622-9521-56abee22ea43 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:33.737989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.739820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.740359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.740838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/groups/88d3f388fef24efeb956ef85b8aebb26/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.744916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab2a11559b044ed1adeb908e8dcb47bf, group_id=88d3f388fef24efeb956ef85b8aebb26, role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.747699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.785290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 218/411] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Jul 25 22:39:33 2022] PUT /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf/groups/88d3f388fef24efeb956ef85b8aebb26/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:33.791291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:33.791988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:33.792276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:33.792575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:33.793383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:33.793696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:33.795166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:33.806756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 194/412] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:33.817612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:33.966550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15268ff-8b06-4ea9-bc04-6ddeaea059c1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:34.007694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:34.026269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:34.027346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.027847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.028365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] PATH_INFO: `/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.029753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] RBAC: Authorizing `identity:get_group(group_id=9a7a8ccc52a54e3686eb801b8617b9df)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:34.031978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a770cd-c204-403a-8db1-25561affc59f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:34.034124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 219/413] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:33 2022] GET /identity/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df => generated 229 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:34.039782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:34.171664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2fde-e153-4fd2-b8c6-62375d9b384b None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.172330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2fde-e153-4fd2-b8c6-62375d9b384b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.172823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c2fde-e153-4fd2-b8c6-62375d9b384b None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.174613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 220/414] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:34.179545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.180059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.180566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.205906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a48daa-0df2-4c67-9ab2-fa40197af207 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:34.208616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:34.210734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:34.266942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:34.268034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.268550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.269016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] PATH_INFO: `/v3/projects/bac6b86a78e2495dac480c2085c0033f` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.270834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] RBAC: Authorizing `identity:get_project(project_id=bac6b86a78e2495dac480c2085c0033f)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:34.272487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:34.276003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 195/415] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:34 2022] GET /identity/v3/projects/bac6b86a78e2495dac480c2085c0033f => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:34.285626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:34.295591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:34.341733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 221/416] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:34.395409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:34.465850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd721fe6-7e9b-4e99-be22-c358422b31ad None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:34.532656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:34.533725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.534158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.534511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] PATH_INFO: `/v3/projects/bac6b86a78e2495dac480c2085c0033f/groups/9a7a8ccc52a54e3686eb801b8617b9df/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.536854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bac6b86a78e2495dac480c2085c0033f, group_id=9a7a8ccc52a54e3686eb801b8617b9df, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:34.538368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:34.563733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 196/417] 10.222.0.59 () {58 vars in 1442 bytes} [Mon Jul 25 22:39:34 2022] PUT /identity/v3/projects/bac6b86a78e2495dac480c2085c0033f/groups/9a7a8ccc52a54e3686eb801b8617b9df/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:34.591113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ba44f-ab3f-42f1-a29c-7ebdf6c28114 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:34.647144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:34.717164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:34.717939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:34.718124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:34.720317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:34.745368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:34.751115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:34.751981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:34.753222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 222/418] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:34.758497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:34.877057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:34.956107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea337-b4e3-428b-a71d-d6e1990edbc3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.004867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.005487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.005763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.006032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.006749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] RBAC: Adding query filter params (name=member) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:35.007047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:35.008695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458823e-4cf5-49be-b023-eb1a8031838d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:35.021813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 197/419] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:35.033198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.067566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2528c-fd10-4d38-a266-3c9ef41ce173 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.068084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2528c-fd10-4d38-a266-3c9ef41ce173 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.068084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2528c-fd10-4d38-a266-3c9ef41ce173 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.069967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 198/420] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:35.075810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.076091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.076742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.102600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:35.104512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:35.193853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 199/421] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:35.221724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f3911-934c-4cdd-976c-9853341599fd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.266727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.267352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.267631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.267903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.273487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.359551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:35.383258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:35.388785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:35.391572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:35.489737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7504283-d1d9-46fa-b420-09df4ea70601 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.530048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.531707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.532279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.532807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.537064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 223/422] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:35.542375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.545050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:35.551360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:35.552229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:35.553039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:35.555281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 200/423] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:35.561525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.679356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71946ff2-0474-40f7-9004-fdca0086f65e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.696209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:35.721049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.722042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.722711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.723179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.724096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:35.724621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:35.726201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:35.736022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 201/424] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:35.742995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.761758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:35.818604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc6f48-f590-4ac7-998f-113416029e56 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.853116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d6605-a77c-4281-a0e7-1b790f154e0d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:35.888148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.888848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.889043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:35.889170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.889396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.890729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.891149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:35.891411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.891864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.892704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c00703-3dc2-4716-b236-2fc2592b05f4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:35.894390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 224/425] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:35.895731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf6e8-63a6-4557-9ab9-6bae13478291 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:35.896830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf6e8-63a6-4557-9ab9-6bae13478291 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:35.896830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaf6e8-63a6-4557-9ab9-6bae13478291 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:35.897520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 225/426] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:35.902498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaf6e8-63a6-4557-9ab9-6bae13478291 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:35.944841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:35.967579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:35.969597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.007843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaf6e8-63a6-4557-9ab9-6bae13478291 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.044843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.045663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.045949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.046224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.047929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.049428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2a9f2-9d9a-4f88-a13b-84c24c709882 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.051881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 226/427] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:36.053575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.053859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.054137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.079702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 202/428] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:39:36.083744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.083857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:36.085397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:36.101677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.177939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.191857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 227/429] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:36.191857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.221878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca16c-3eb1-4613-be48-0c542cfff19d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.267794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.269354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.269954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.270517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.271743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=487df376a9e74299a45758c37395c1f2) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:36.272636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.274812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.282686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 203/430] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:36.284530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.330560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648286c-6ee7-4ce2-89df-a0ed240a8b73 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.389881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.392024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.392568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.393080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] PATH_INFO: `/v3/projects/487df376a9e74299a45758c37395c1f2` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.395527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] RBAC: Authorizing `identity:get_project(project_id=487df376a9e74299a45758c37395c1f2)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.398345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a33fd-a66e-4f38-a777-cdf73d1c01c9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.402338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 228/431] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/projects/487df376a9e74299a45758c37395c1f2 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:36.403998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914884-01a4-4382-a7c3-fc6d99d7e489 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.404523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914884-01a4-4382-a7c3-fc6d99d7e489 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.405001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75914884-01a4-4382-a7c3-fc6d99d7e489 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.407794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 229/432] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:36.409100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75914884-01a4-4382-a7c3-fc6d99d7e489 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.425487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce54b56-e981-4870-8368-0a96616bab29 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.435174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.466332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.466978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.467260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.467592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.480641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.486438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b1a7444e-f28f-4da7-851e-112f7e4ae50e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:36.491687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:36.492652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:36.493451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 204/433] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:36.494118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.494328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.494601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.514308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:36.515828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:36.559510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75914884-01a4-4382-a7c3-fc6d99d7e489 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.614249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.614908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.615182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.615462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.616831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.618263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.619858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 230/434] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:36.623592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 205/435] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:36.624343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.626461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.736053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.766044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea101c95-f071-40c0-a13d-63b63d5efb29 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.769687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c33f72-a897-4b57-b48d-351f250b1f2b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.801482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:36.804929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.805748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.806032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.806305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.807036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] RBAC: Adding query filter params (name=member) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:36.807468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.808507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30264-31a7-449c-a657-08874352267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.809008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.809511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30264-31a7-449c-a657-08874352267a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.809795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30264-31a7-449c-a657-08874352267a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.810069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30264-31a7-449c-a657-08874352267a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:36.810994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30264-31a7-449c-a657-08874352267a None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=487df376a9e74299a45758c37395c1f2) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:36.811314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30264-31a7-449c-a657-08874352267a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:36.813380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30264-31a7-449c-a657-08874352267a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:36.823327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 231/436] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:36.823327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.824462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 206/437] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=487df376a9e74299a45758c37395c1f2&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:36.825709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30264-31a7-449c-a657-08874352267a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:36.948658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c00ff-c3c5-489e-a36a-a8f975f74f36 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.980202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30264-31a7-449c-a657-08874352267a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:36.994227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:36.995593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:36.995593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:36.995593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.014046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:37.024148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:37.025400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:37.026224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 232/438] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:37.028909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.029704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.030143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.030611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.032320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.036641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.102377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.110954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.112473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5335b-1389-466d-83c2-3b4b4114f15e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.157720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50713986-730c-467c-be8e-042e7b9c7219 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.197967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.198596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.198874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.199144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.199863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:37.200191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.201730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f191e8e-529d-4b41-9574-486f6d2dcf71 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.211585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 233/439] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:37.214768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746df1a-c005-4cfe-9397-457b99e88f19 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.215052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746df1a-c005-4cfe-9397-457b99e88f19 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.215324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746df1a-c005-4cfe-9397-457b99e88f19 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.216663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 234/440] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:37.217369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746df1a-c005-4cfe-9397-457b99e88f19 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.232065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 207/441] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:37.233354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.233627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.233953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.251900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:37.253094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:37.282475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.319970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 208/442] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:37.320812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746df1a-c005-4cfe-9397-457b99e88f19 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.321184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.345330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.365171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.365908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.366235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.366528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.421740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa08d6-d222-45c9-9b1b-244fef5f9b06 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.434183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.435646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.455936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.456594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.456875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.457148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.458294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.459716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.461399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 209/443] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.462142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.496101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.534242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 235/444] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:37.534997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.560190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.570026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28158702-e3a2-47d5-919b-ef2780529425 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.603725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.604394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.604674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.604943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.615413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:37.620428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:37.621470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 210/445] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:37.622439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.634521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0734baaa-4ff4-44fc-9ded-f50bba9d59d5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.667333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.667971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.668248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.668543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.669662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.671101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.673376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 236/446] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.674175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.704009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.726380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a169-97c2-4deb-84a5-a807e015dc58 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.760146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.760811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.761086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.761354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] PATH_INFO: `/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.762485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] RBAC: Authorizing `identity:get_project(project_id=ab2a11559b044ed1adeb908e8dcb47bf)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.763923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.765833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 211/447] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/projects/ab2a11559b044ed1adeb908e8dcb47bf => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.766491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.776489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b623-b8b5-4933-8d1d-ecdb669ff206 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.786864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.809951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.810561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.810835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.811106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.811881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:37.812798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.814169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.822216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 237/448] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.823008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.865908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9119344-128d-4804-919d-d899e3c4488b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.899486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.900098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.900420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.900703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.901496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=14635753bbaa46bfb5475d51ad0b91a5, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:37.901805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.903234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.909496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 212/449] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=14635753bbaa46bfb5475d51ad0b91a5 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.910278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:37.920406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:37.929367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21509d4-42f2-46ce-8ea5-b5b1ad1e7b89 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:37.969188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:37.969853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:37.970138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:37.970414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] PATH_INFO: `/v3/groups/88d3f388fef24efeb956ef85b8aebb26` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:37.971665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] RBAC: Authorizing `identity:get_group(group_id=88d3f388fef24efeb956ef85b8aebb26)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:37.973180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:37.974836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 238/450] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/groups/88d3f388fef24efeb956ef85b8aebb26 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:37.980891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:38.016106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:38.035177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7845462-0fc5-46c0-a717-77e60c961bef None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:38.072195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:38.073689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:38.073689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:38.073689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:38.102506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a21a92-9481-42d3-a906-742655f52839 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:38.152380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:38.153164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:38.153445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:38.153766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:38.154673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] RBAC: Adding query filter params (group.id=88d3f388fef24efeb956ef85b8aebb26, role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:38.155005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:38.156505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:38.161872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:38.163765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:38.163873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 239/451] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/role_assignments?group.id=88d3f388fef24efeb956ef85b8aebb26&scope.project.id=ab2a11559b044ed1adeb908e8dcb47bf&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:38.262733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:38.281021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 213/452] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:38.287054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:38.321825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:38.397135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d1d2e-9a02-4d09-9616-277beead9df6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:38.430434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:38.431075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:38.431356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:38.431639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] PATH_INFO: `/v3/projects/bac6b86a78e2495dac480c2085c0033f` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:38.432822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] RBAC: Authorizing `identity:get_project(project_id=bac6b86a78e2495dac480c2085c0033f)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:38.434269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:38.435918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 240/453] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:39:38 2022] GET /identity/v3/projects/bac6b86a78e2495dac480c2085c0033f => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:38.442073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:38.542156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b442885-59bc-4cfc-91fa-bf1f1c637629 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:38.575019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:38.575646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:38.575919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:38.576186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] PATH_INFO: `/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:38.577330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] RBAC: Authorizing `identity:get_group(group_id=9a7a8ccc52a54e3686eb801b8617b9df)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:38.578797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7724054-f4d8-46f7-93c3-0c0d2e472c78 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:38.580392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 214/454] 10.222.0.59 () {56 vars in 1180 bytes} [Mon Jul 25 22:39:38 2022] GET /identity/v3/groups/9a7a8ccc52a54e3686eb801b8617b9df => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:38.586182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:38.678553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:38.685284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563225fd-e48f-472d-9d34-4999ace2c94e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:38.716965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:38.717571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:38.717850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:38.718672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:38.719433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] RBAC: Adding query filter params (group.id=9a7a8ccc52a54e3686eb801b8617b9df, role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=bac6b86a78e2495dac480c2085c0033f) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:38.719747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:38.721177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c38c0e-f389-47b4-9090-bb13b0710194 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:38.726689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 241/455] 10.222.0.59 () {56 vars in 1376 bytes} [Mon Jul 25 22:39:38 2022] GET /identity/v3/role_assignments?group.id=9a7a8ccc52a54e3686eb801b8617b9df&scope.project.id=bac6b86a78e2495dac480c2085c0033f&role.id=e3f77a14908d48e99043f557a465098a => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:41.331349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c40-f303-4521-92ae-7bd993da9ebb None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.331862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c40-f303-4521-92ae-7bd993da9ebb None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.331862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f59c40-f303-4521-92ae-7bd993da9ebb None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.333534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 215/456] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:41.349989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.350918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.351390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.377318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:41.378960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:41.450769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab39a-d670-4b28-a1bb-4c6c92df5d41 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.451372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab39a-d670-4b28-a1bb-4c6c92df5d41 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.451869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ab39a-d670-4b28-a1bb-4c6c92df5d41 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.457508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 216/457] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:41.458972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbc6b-a1cb-404e-b358-82ef3c57ce6d None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.459462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbc6b-a1cb-404e-b358-82ef3c57ce6d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.459918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfbc6b-a1cb-404e-b358-82ef3c57ce6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.463008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 242/458] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:41.497279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-5fcfbc6b-a1cb-404e-b358-82ef3c57ce6d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:41.498742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5fcfbc6b-a1cb-404e-b358-82ef3c57ce6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:41.512855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:41.592641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:41.618916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 217/459] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:41.621486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cca16-14f7-4948-befd-461673185089 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.621985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cca16-14f7-4948-befd-461673185089 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.622730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024cca16-14f7-4948-befd-461673185089 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.625577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 218/460] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:41.633698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.634004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.634281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.655492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:41.661453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:41.662652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:41.670746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb432be-0147-4ab6-938f-246dd63e1652 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:41.707827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:41.708892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.709423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.709913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.721856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:41.723690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:41.733030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 219/461] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:41.733955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:41.742999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:41.743889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:41.745160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:41.745160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:41.745160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:41.745160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:41.746962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 243/462] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:41.753782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:41.842504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c1d4c-33d5-4504-81eb-3d1ec15e1080 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:41.858860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:41.862307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815e991-dfaf-44b9-a9fc-d326c471ef8d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:41.882618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:41.883264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.883543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.883816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.897885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:41.899345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:41.899918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:41.900792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:41.901269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:41.901738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:41.902645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:41.903171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:41.904763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:41.915236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:41.916065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:41.916911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:41.916911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:41.916911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:41.916911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:41.920362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 220/463] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:41.921573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:41.925466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:41.930905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 244/464] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:41.931882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.040356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e683d0f-628d-4583-ab0b-2194342d3032 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.052695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af0dc2-d501-49a3-bd75-070a23038f61 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.078141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.079048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.079504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.079979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.080877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:42.081356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.082907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.094218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.094859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.095136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.095403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.096795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 245/465] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:42.097771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.114071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.115711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:42.135046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:42.144881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 221/466] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:42.146770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.160441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.178387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.238215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971c4f-97c5-4fc3-9e07-6508e4ef46a6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.252141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24fe99a-644d-4db9-abe6-7e7b626e451a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.280026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.280717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.281015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.281340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.282018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.283436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.286451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.287066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.287349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.287625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.288322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.289750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6da43a-3bbf-4e39-9a85-d88ba16bb2d6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.306165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 246/467] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:42.306998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.319507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 222/468] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:42.321521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb5cc3-ab43-4f25-a52c-2c9c5d34169f None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.322102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb5cc3-ab43-4f25-a52c-2c9c5d34169f None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.322626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb5cc3-ab43-4f25-a52c-2c9c5d34169f None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.329051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 223/469] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:42.334349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.335585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.336101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.361792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:42.364234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:42.458919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 224/470] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:42.489690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.492895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.559594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec96e3-2947-49e3-84ba-c9d66a777339 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.578793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.606791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.607518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.607890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.608239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.610215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:42.610215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.611445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.623758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4e5c1-5d1d-45a7-bddf-b2204a441460 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.625937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 247/471] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:42.631334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.667851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.668932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.669389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.669832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.683782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.685694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:42.703472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:42.704507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:42.705874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:42.705874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:42.705874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:42.705874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:42.707004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 225/472] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:42.711275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.759873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4cc58-14b6-4164-aca1-037b3c32c138 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.769076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.809732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.810273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.810555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.810834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.811522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.813036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a881b-adf7-46e2-a8d2-68db14a1539c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.824376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29312d2c-ea73-453d-9fdf-8099b937bbf2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:42.839231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 248/473] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:39:42.840893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba017-93bc-4e92-9011-db88a15220b9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.841426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba017-93bc-4e92-9011-db88a15220b9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.841715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ba017-93bc-4e92-9011-db88a15220b9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.844990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 249/474] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:42.852322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.852624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.853036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.871629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:42.872340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:42.872638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:42.872920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:42.873637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:42.873950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:42.875514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:42.877452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:42.879327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:42.890425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 226/475] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:42.896874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:42.917398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:42.968570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 250/476] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:43.004077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:43.075633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf311-8d87-4d5a-8564-e4933122ee26 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:43.095954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:43.127359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:43.127359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:43.127359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:43.127359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:43.128155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:43.130185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:43.159541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72eb9d-5df3-4d37-a347-4aa577b6db39 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:43.160939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 227/477] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:42 2022] POST /identity/v3/users => generated 249 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:43.201185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:43.201828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:43.202186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:43.203160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:43.203906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:43.205362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:43.217269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.sql.core [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:39:43.217269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:39:43.217269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [parameters: {'id': '3f54676c695e41f68c9d53a3d95aab01', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:39:43.217269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87030) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application result.read() Jul 25 22:39:43.235882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:39:43.236831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application yield resource Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise self.value Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application session.commit() Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:39:43.237757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:39:43.238639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:39:43.239540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application result.read() Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:39:43.241321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [parameters: {'id': '3f54676c695e41f68c9d53a3d95aab01', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:43.243357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 22:39:43.245461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:43.247450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 251/478] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Jul 25 22:39:43 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:43.247584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:43.376028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abd19e-09fa-4d2b-b284-be2ab1b055da None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:43.416720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:43.417370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:43.417649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:43.417920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:43.432511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-1116f0bd-13bc-4853-8baa-06d70dd93d3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:43.441092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:43.443395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:43.445568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 228/479] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:39:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:43.452794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:43.480456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:43.569631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fba5c-176c-45fa-8ec6-a4c96cece954 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:43.611264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:43.611898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:43.612179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:43.612477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:43.613208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:43.613515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:43.614881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffac24-c6aa-46f6-a3ca-d59ca33fca38 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:43.623904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 252/480] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:44.777712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5e90-d2e7-459b-ae1c-f975462d6860 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:44.778272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5e90-d2e7-459b-ae1c-f975462d6860 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:44.778272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe5e90-d2e7-459b-ae1c-f975462d6860 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:44.779868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 229/481] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:44.784977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:44.785384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:44.785527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:44.809882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:44.811058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:44.829564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7512f-c616-4814-8f0a-d49279093ff3 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:44.830021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7512f-c616-4814-8f0a-d49279093ff3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:44.830435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7512f-c616-4814-8f0a-d49279093ff3 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:44.832094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 230/482] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:44.849754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:44.850219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:44.850566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:44.876923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:44.878326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:44.898069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 253/483] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:44.914044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:44.935761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:44.976684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:44.992223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 231/484] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:45.020298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.129857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6006-e056-4acd-90f0-a47237b6d6c0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.138930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635b17d-d292-416f-b742-c190b4d80426 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.177528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.178175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.178452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.178723 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.189954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:45.195466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:45.197559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:45.199476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 232/485] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:45.203636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.217011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.218458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.218747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.219021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.228712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:45.247754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:45.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:45.255410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:45.257412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 254/486] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:45.265289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.312749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3275c-9e8c-40de-b38f-8a3652a0e97a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.353413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.354378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.354657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.355454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.356192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:45.356520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:45.358096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:45.367502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 233/487] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:45.372993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.476868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:45.486251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4318033-e7ba-42be-90f4-e925d5ce1b5a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.513195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:45.525938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.526582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.526861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.527134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.538678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:45.540208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:45.558110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:45.560548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:45.562660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:45.562660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:45.562660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:45.562660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:45.562660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 234/488] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:45.568306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.583241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d3438-b435-4c06-8502-968f16cd1d5f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.625680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.626307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.626590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.626877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.627707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:45.628022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:45.629535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d380d-0013-4748-8feb-749e5b62c51d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:45.638961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 255/489] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:45.640279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae1eb-1fe3-4ad6-abac-7a8e59cfb372 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.640622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae1eb-1fe3-4ad6-abac-7a8e59cfb372 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.640899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dae1eb-1fe3-4ad6-abac-7a8e59cfb372 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.642277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 256/490] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:45.647156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dae1eb-1fe3-4ad6-abac-7a8e59cfb372 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.703407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09f6b5-90eb-42c4-85f7-2faf98fd9430 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.740489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.741068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.741359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.741637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.742341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:45.742650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:45.744026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593effff-a883-49b0-b7da-f881c2f9c9ce None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:45.745851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:45.758021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 235/491] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:45.759459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.759847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.760226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.779540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:45.781534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:45.784204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dae1eb-1fe3-4ad6-abac-7a8e59cfb372 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:45.833409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:45.834042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:45.834484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:45.834880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:45.847406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:45.851156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:45.854221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:45.868415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 236/492] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:45.869436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:45.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:45.871495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:45.873091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:45.873091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:45.873091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:45.873091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:45.873091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 257/493] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:45.877648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:45.991910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96e513-ca84-41fb-ad3c-237c0df35b6e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.009786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d1f34-a7aa-475d-b734-9bc62d42fe0e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.017691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.032185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.033154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.033445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.034113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.044330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.046357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.051838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.052504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.052790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.053067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.053778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:46.054084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.055451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c0644-0686-40e6-9ab4-28d32727834d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:46.061744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:46.062834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:46.063856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 237/494] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:46.064577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.071706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 258/495] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:46.073185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8e120-801f-4791-b7a7-16dc4b465a7e None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.073598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8e120-801f-4791-b7a7-16dc4b465a7e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.073950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8e120-801f-4791-b7a7-16dc4b465a7e None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.075645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 259/496] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:46.076598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8e120-801f-4791-b7a7-16dc4b465a7e None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.143500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.173289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30ee5b-03a3-4839-88a3-c39f846924d7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.199755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8e120-801f-4791-b7a7-16dc4b465a7e None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.208312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.208963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.209240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.209515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.220538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:46.226297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:46.227204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:46.228011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 238/497] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:46.228726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.245159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.246008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.246534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.246952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.248680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:46.250018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.251699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06753e43-b0cc-4a76-99aa-c56aaecab83b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.279264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.289763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 260/498] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:46.291215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.291503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.291780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.311065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:46.312887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:46.338995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a6a49-b2ee-419d-86de-1037da208240 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.370677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.371304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.371582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.371852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.379036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 261/499] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:46.379878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.393296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.394886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:46.406927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:46.407988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 239/500] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:46.408953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.424848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.482657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addc01c-49e7-4fa7-a286-b0b54a006a00 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.508373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb9b50-3f6c-4630-88cf-6aa63173f80f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.510864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.518095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.518715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.518990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.519260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.519973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:46.520271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.521663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bdb11-bcdb-4e74-8451-54213610d90b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.529542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 262/501] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:46.530998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55d7e6-53c9-4e5f-ac0b-e36e950a8b3b None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.531287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55d7e6-53c9-4e5f-ac0b-e36e950a8b3b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.531640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55d7e6-53c9-4e5f-ac0b-e36e950a8b3b None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.532811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 263/502] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:46.533505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55d7e6-53c9-4e5f-ac0b-e36e950a8b3b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.552042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.552714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.552995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.553269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.620328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.621792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.636155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55d7e6-53c9-4e5f-ac0b-e36e950a8b3b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.637694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.669112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.669831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.670203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.670546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.681030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:46.687126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:46.688145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:46.688978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 264/503] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:46.689655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.724169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 240/504] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:46.724534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.727962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.790547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f85b-6d4f-4e29-8ad1-78afced9a8f9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.822815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f7994-1cce-4281-94fe-abee2ec21206 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:46.825047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.825659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.825941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.826212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.827017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:46.827324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.828933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5ed86-782b-48bf-8030-dc196be2d5e2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.846428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 265/505] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:46.848460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.848804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.849084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.859528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:46.860162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:46.860475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:46.860747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:46.866614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:46.867803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:46.870451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:46.871863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:46.883307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:46.886825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:46.887682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:46.888544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:46.888544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:46.888544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:46.888544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:46.888544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 241/506] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:46.888817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.938206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 266/507] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:46.939008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:46.951167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:46.995921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74ec02-cc59-4208-a596-8e8367649cff None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.028330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.028952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.029233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.029513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.030771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:47.031077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.032470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.038407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a32a5-76b1-4991-8c73-a0ff0d677816 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.040229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 242/508] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:47.041100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.072540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.073188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.073469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.073744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.083796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.085282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:47.100625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.101636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 267/509] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.102487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.105112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.146908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731f54a-09ca-4554-bf50-00d27be24176 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.163975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.181151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.181765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.182044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.182319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.211787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e5f0-c3ec-43b4-a1ab-441625c317d9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.245622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.246234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.246513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.246868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.247496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.247600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:47.247850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.249026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.249250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.261228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 268/510] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:47.261942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.321492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.351831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 243/511] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:47.352702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.359178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34b37-945b-4428-8de0-38e1b1775878 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.371091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.392268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.392934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.393219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.393487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.403273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.404747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:47.419114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.419992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.421427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:47.421427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:47.421427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.421427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:47.421427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 269/512] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.421694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.454154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71211-4ac8-4642-850d-c4d518ca0de3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.487860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.488516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.488793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.489064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.500111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.501686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:47.515829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.516736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.517553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:47.517553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:47.517553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.517553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:47.517553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 244/513] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.517828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.523586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcee80-45ec-48f3-af36-7e27bdfcb3d0 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.537229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.559524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.560145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.560486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.560767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.562074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:47.562382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.563740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.575234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 270/514] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:47.575960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.585643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.617043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1f314-408f-409b-985c-165f47e9a7f0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.649630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.650268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.650573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.650848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.658678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.660118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:47.671613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.672714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 245/515] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.673725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.682123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07ffa4-7a08-4a98-a498-ccc187a9e9a2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.715752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.716430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.716698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.716973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.727368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.728868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:47.743978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.745003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.745864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:47.745864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:47.745864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:47.745864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:47.745864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 271/516] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.746131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.772107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a83a7-f62c-4620-8912-bd496d4ffb82 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.773830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.801054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:47.806975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.807587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.807869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.808144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.808869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:47.809176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.810554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.821876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 246/517] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:47.822659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.853056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceff0fb-5432-4de7-8591-d565e0b80dc6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.886120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.886733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.887009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.887279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.887961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:47.888261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.889664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.901119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 272/518] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:47.901729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.925133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3c707-82e9-42dc-a78c-22900f9b76b9 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:47.958865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:47.959505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:47.959779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:47.960049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:47.966841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:47.968805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:47.980264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:47.981306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 247/519] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:47.982342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:47.987254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.003451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7981f6-49bc-4fe8-a05b-f44168f80fae None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.033503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.037747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.038442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.038790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.039146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.040011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.040344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.041768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.058439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 273/520] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:48.059211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.082927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac23b7-b5d5-4173-98ff-086b5791f7cd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.116721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.117328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.117647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.117871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.118554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.118854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.120204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.132612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 248/521] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:48.134770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.162070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9d6ed-1c35-41d8-a8e4-e3839bae7d1c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.194620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.201886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.202681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.202960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.203657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.205117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.222679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.228677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 274/522] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:39:48 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:39:48.229480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.248817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b802451-0b70-4357-a055-a0ab7ef0b13c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.261120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.290728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.291548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.291831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.292106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.300759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.302831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:48.315716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:48.316922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:39:48.318029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:48.322033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 249/523] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:48.322838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.357091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0e12-ee58-403b-a3e3-48ba1df5a3c2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.396697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.397244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.397521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.397793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.398550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.398857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.400310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.418785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 275/524] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:48.419468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.450693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43956e0-2293-4a7e-a985-844925fee3e0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.486585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.487449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.488126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.488501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.488762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.529764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.539118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584eb00b-db23-4111-8fc9-9482937bb030 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.565199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.566752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.576417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.577766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.578106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.578450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.585568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.587103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:48.599621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:48.600704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:48.601839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:48.607500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 276/525] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:48.607500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.683467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 250/526] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:48.684149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.722301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ede74-0052-473d-a738-30b9d00f0aa9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.742647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.760795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.761233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:48.761430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.761696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.761976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.762778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.763096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.765119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.788947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 277/527] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:48.789753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.796929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66fab2-6974-483a-85c5-93e1501bb2d2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.833936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.834550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.834834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.835105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.835890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.836221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.837739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:48.843495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 251/528] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:48.844276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:48.934368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa9c54-1e84-4105-8c6b-0ae2ce03d19d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.972405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15893d4-1677-4c9d-bb9d-2928692d1941 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:48.991133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:48.992389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:48.992850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:48.993560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:48.995064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:48.995565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:48.997257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.014807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 278/529] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:49.015960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.020899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.021271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.021555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.021833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.029514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.034084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.035700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:49.051801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:49.052776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:49.053796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:49.053796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:49.053796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:49.053796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:49.053796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 252/530] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:49.054881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.084720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.134630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b4a80-590e-464b-ac74-37a4dd13bb8e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.173903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.174958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.175497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.175975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.177892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198650a-9cb3-4da2-9b36-4fd245b21677 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.214936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.215922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.216480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.217029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.218569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=bfd0c9fabb1040cd9055b16f3504301f) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:49.219087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.220845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.228518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 253/531] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/role_assignments?user.id=bfd0c9fabb1040cd9055b16f3504301f&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:49.229739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.293937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.296746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.347698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.384718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.426839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dff9-a412-4d80-88e7-4d949f0e8ffa None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.464665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.465664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.465941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.466223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.466925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:49.467231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.468432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 279/532] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:49.473378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.481421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.492154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 254/533] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:49.493948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.608826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf1346-5790-4f2e-9329-f3266eb0d4c3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.621288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.648689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.649865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.650205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.650632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.659596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.661152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:49.674796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:49.675679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:49.676556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:49.680520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 255/534] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:49.683423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.697204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f9e19-3229-4801-b98c-4bd8e7462d52 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.779451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.784026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.786024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.786498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.804637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:49.805880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.808070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:49.834998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:49.835908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:49.836763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:49.836763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:49.836763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:49.836763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:49.843339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 280/535] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:49.845621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de468b-6294-4379-8c2f-453abf1f7772 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.849048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:49.941903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.942601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.942889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.943194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.943924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:49.944236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.945896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.955096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f7592-4503-4541-8ad1-3ac5c175c658 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:49.987683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 256/536] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:49.990499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:49.991347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:49.991843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:49.992339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:49.993258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:49.993755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:49.995297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:49.997251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.009471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 281/537] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:50.015099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.076772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:50.112179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:50.221680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bce3b-11de-4b88-abe0-b773144ca916 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.227777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500350e-9f46-489c-b471-bd336f455a84 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.295110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.296304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.296592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.296870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.297671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=117a0317f7994b59a6a23786c9155399) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:50.297984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:50.299421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:50.303081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.303721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.303998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.304275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.316149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:50.317632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:50.318313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 257/538] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:49 2022] GET /identity/v3/role_assignments?user.id=117a0317f7994b59a6a23786c9155399&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-b6d7532d-952e-4a2a-b572-034b1a114a98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:50.330696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:50.331597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:50.332503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 282/539] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:50.337637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.392132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4846-7b66-4165-87b6-63c1acda8cc0 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.392775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4846-7b66-4165-87b6-63c1acda8cc0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.393279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e4846-7b66-4165-87b6-63c1acda8cc0 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.394852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 283/540] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:50.400170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.400767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.401288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.431166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:50.433755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:50.502084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:50.510904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c58de-9940-46f7-adac-55e56bcdf6da None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.551003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 284/541] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:50.560472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.561973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.562467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.562964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.564428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:50.564960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:50.566721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:50.580330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 258/542] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:50.585930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.593194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.631859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:50.719185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c84ee-97e1-4596-8ae6-e7270d7030b0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.735572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596a15-1517-475c-a090-3f2993544a97 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.774721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.775417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.775699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.775966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.788358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:50.793955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:50.794825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:50.796168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 259/543] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:50.802683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:50.821687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:50.828996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.829638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.829913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.830193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.831000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=9fc7adc92a5b41bea6a0929eadc50689) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:50.831309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:50.832773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:50.847515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 285/544] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/role_assignments?user.id=9fc7adc92a5b41bea6a0929eadc50689&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:50.923055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de851-c91a-487e-b343-e63ba0840749 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:50.959751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:50.960759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:50.961233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:50.961693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:50.962696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:50.963498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:50.965172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd635d-5215-4ab0-83dd-5384e88f9663 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:50.975497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 260/545] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:50.981480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.093916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd10471-f9ee-41e3-8a90-acd5a92619cc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.096964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:51.131532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.132194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.132504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.135243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.135395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203044-c8d7-428b-888e-ae7f7a89e8fd None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.135797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203044-c8d7-428b-888e-ae7f7a89e8fd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.135878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b203044-c8d7-428b-888e-ae7f7a89e8fd None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.137911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 261/546] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:39:51.144025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.144329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.144611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.154197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:51.156235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:51.169111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:51.170619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:51.173875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:51.174706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:51.175528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:51.175528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:51.175528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:51.175528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:51.175528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 286/547] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:51.182946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.320889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 262/548] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:39:51.356486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170f84-2105-4dc4-bbbd-c67ee8ad64dc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.358647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.366820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:51.417340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.417883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.418162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.418440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.419133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:51.419441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:51.420868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:51.433660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 287/549] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:51.441300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.461465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:51.569040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0593-9cab-4676-bd9f-eaa6d5594b99 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.590875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d00d72-e17d-4ebf-ae8b-e778e249c866 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.608409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.609414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.609794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.610166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.622201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:51.628374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:51.629924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:51.631066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:51.632905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 263/550] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:51.641664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.677133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.677733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.678017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.678305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] PATH_INFO: `/v3/users/swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.693426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:51.694893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:51.714598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3cccf896-f069-4a11-b0db-95f77e721bff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:51.716540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:51.717442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:39:51.718473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:51.722394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 288/551] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:51.723755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d06a5-43ec-4bbc-a72b-972a5d2ab12c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.724045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d06a5-43ec-4bbc-a72b-972a5d2ab12c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.724356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d06a5-43ec-4bbc-a72b-972a5d2ab12c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.725818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 289/552] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:51.726390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d06a5-43ec-4bbc-a72b-972a5d2ab12c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.753383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717bea0-8fc9-443b-a321-f51d9e9657f1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.789169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.789793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.790073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.790346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.791064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:51.791369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:51.792782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d9aa97-52e3-4080-818e-213417a1b0c6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:51.801849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 264/553] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:51.803136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.803419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.803696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.822030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:51.822283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:51.823859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:51.850400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d06a5-43ec-4bbc-a72b-972a5d2ab12c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:51.887939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:51.888893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:51.889354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:51.889777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:51.890924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:51.891384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:51.893128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:51.908310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 265/554] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:51.908310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.932879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 290/555] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:51.939516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:51.971711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.015831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b68b9-7212-4bad-9e0b-0223061776f0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.053801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.054471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.054755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.055030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.056844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63713cae-9247-4309-ac85-9e24abb8d577 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.065849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.067548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:52.084128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:52.085246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:52.086340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:52.086340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:52.086340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.086340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:52.090175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 266/556] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:52.091027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.098133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.098972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.099404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.099826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.102855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.183983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.185842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.200763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552983f5-5a72-48fe-a08d-a99bfe7d62b0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.213809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.244629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.245474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.245971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.246465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.259999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:52.266508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:52.268133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 267/557] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:52.269113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.310286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 291/558] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:52.316476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.353882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.381944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cdd9e-e54e-4eea-b1a8-15a5e7a0364b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.418676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.419270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.419552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.419827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.420577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:52.420886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.422372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.429139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79abc72-6626-437c-add4-62e9be8b80ab None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.440085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 268/559] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:52.440928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.467967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.468989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.469456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.469911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.470945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:52.471534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.473108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.473959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.483386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 292/560] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:52.484577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.551592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69d331-10e5-44bd-8e73-5c72be842c15 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.590128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.590970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.591255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.591534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.595539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.603448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de147f-ab6f-4d5e-9374-f4e9a8b020e6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.610269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.611765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:52.636046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:52.637029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:52.637928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:52.637928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:52.637928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.637928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:52.640359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 269/561] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:52.641409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.654508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.655165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.655451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.655788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.663940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.665528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:52.677624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:52.678644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 293/562] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:52.679574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.744261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.766749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa3e58-6cd3-402b-94b2-f4262135584c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.785310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef398f3-2d22-4077-a337-a2d5889ba406 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.805545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.806426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.806894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.807178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.818812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.820230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.825528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.826153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.826439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.826775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.827574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:52.827839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.829249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-ac46ed6a-c030-460b-8050-005858c5dc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:52.837701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:52.838884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:52.839843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:52.839843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:52.839843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:52.839843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:52.844317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 270/563] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:52.844456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 294/564] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:52.845373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.850827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78b04-6108-4668-8f4b-95b6cae741a4 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.851249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78b04-6108-4668-8f4b-95b6cae741a4 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.851619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b78b04-6108-4668-8f4b-95b6cae741a4 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.853236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 271/565] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:52.857218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78b04-6108-4668-8f4b-95b6cae741a4 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:52.867796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:52.950956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0242ee-ddc4-43c7-8c48-e61544d5503d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.972166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b78b04-6108-4668-8f4b-95b6cae741a4 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:52.993922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:52.994607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:52.994830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:52.995188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:52.995894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:52.996198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:52.997643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.008400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.009022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.009307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.009585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.010280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.010591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.011966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0b42b-d6a0-494d-9536-42b07e22e9de None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.013671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.016066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 295/566] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.017173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.025318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 272/567] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.026612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.026903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.027180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.046514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:53.047749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:53.101822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.119103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 273/568] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:53.119965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.147066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f381f-2772-4399-808f-c7a7f7a3a9bf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.184891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.185534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.185813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.186120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.193015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.194470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:53.206338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:53.207224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:53.208083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 296/569] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:53.208690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.239565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb620662-f75b-4df7-b373-51ead8d1f3df None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.262516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.274731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.275010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.275282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.286324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.287781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:53.302207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:53.303154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:53.304036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:53.304036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:53.304036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:53.304036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:53.304036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 274/570] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:53.304354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.312246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921d4f4-f382-48a4-bc59-68a283910614 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.346367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.346999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.347278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.347549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.349436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.355869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.357334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-01e1a57b-7ba0-4089-8c0d-b2a4658a424b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:53.368231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:53.369316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 297/571] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:53.370641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d86-ce5e-41bc-ba14-b13bdd50ee7d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.371418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d86-ce5e-41bc-ba14-b13bdd50ee7d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.371418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b24d86-ce5e-41bc-ba14-b13bdd50ee7d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.372205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 298/572] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:53.374253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24d86-ce5e-41bc-ba14-b13bdd50ee7d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.406455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ebbfc-9393-4752-bfa3-15c8faeac17c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.438827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.439467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.439754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.440031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.450022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:53.456733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:53.457856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 275/573] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:53.458769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.478371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b24d86-ce5e-41bc-ba14-b13bdd50ee7d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.492888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.512485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.513138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.513380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.513655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.514959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.515215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.516656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.528361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 299/574] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.529163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.559777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854bf6f8-4ae3-475a-b6b7-8b44a84a0248 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.584060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.595495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.596349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.596646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.596914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.597604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.597912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.599291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7af89e-eccf-4268-a45e-0f71e37dcd39 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.611487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 276/575] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.612487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.612779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.613054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.629823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:53.630212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe18596-b8e8-4cf2-b33a-0b469f4aa875 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.631013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:53.664738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.665348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.665626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.665898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.666689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.666993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.668432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.684867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 300/576] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.685630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.697479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 277/577] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:53.698300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.724923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.795367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ef1d5-6a6d-4937-a36c-e316c7c09ffa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.796136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59385dc3-2b70-4f53-9086-2d27179d5aa0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.808142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.829657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.830271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.830549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.830818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.830956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.831601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=8d2a9820c2314fd8acbf6739408980af) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.831696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.831911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.832074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.832444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:53.833220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:53.833371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.833651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:53.835046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:53.839329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 278/578] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/role_assignments?user.id=8d2a9820c2314fd8acbf6739408980af&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.840107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.843865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 301/579] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:53.844676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:53.952628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:53.955205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcebf83-9eb0-436a-a073-c6025a72e239 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.965475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce9410-4b75-4cce-bc4c-ca12e17e1e19 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:53.992874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:53.993516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:53.993794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:53.994063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.008167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.009153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.009650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.009822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.010079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.010351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.018537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.019756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:54.024689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.025534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.026424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:54.026424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:54.026424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.026424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:54.026424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 302/580] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.027143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:54.036130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.037048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:54.038011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:54.040924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 279/581] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.042140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.059298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.142998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d40fc-d659-44c9-9e6a-44bfcf8a248c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.151775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccf90e-3520-4e70-88c3-541c4d333b39 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.180805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.181448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.181729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.182004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.188856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.189888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.190641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.191143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.192956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:54.198341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.199338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 303/582] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.205096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.205865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.205865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:54.221871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.222791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.223656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:54.223656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:54.223656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.223656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:54.223656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 280/583] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.223944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.230862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.300827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.316441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cbcaa-080a-434b-8d7c-cb15d6b8d5d4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.344826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a9b18-3a52-4353-8700-ce98c38bc6f6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.351090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.351706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.351989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.352264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.352983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:54.353286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.354644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.367265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 304/584] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:54.368077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.384397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.385572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.386014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.386432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.387406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:54.387962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.390322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.404037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 281/585] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:54.405587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.470634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.478251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cd658-8855-40aa-ae13-6c4a14a3b54f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.511331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcb96-38cd-4269-9163-db4f430ad36c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.514138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.515361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.515640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.515914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.516671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:54.516980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.518340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.526403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 305/586] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:54.529148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.544331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.549985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.551003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.551381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.551658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.552385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:54.552692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.554286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.567182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 282/587] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:54.572667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.640871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45413be9-eeaf-4c7a-b7f7-3ad544cdcebd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.675077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.675803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.676156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.676533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.677123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4de838-fadf-4e86-81c9-d748b3324cbe None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.684166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.685652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:54.697428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.698325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:54.699201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 306/588] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.699683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.705621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.719075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.719752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.720034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.720331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.736468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=0683955d11d0442cae5e9e4d4f973e10, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.738667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.764778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 283/589] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:54 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:54.764778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.776878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:54.819243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801478d3-0892-49ca-9d91-372cc49ae630 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.859743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.860638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.860994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.861337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.875201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.876998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:54.894385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.895579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.896693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:54.896693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:54.896693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:54.896693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:54.896693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 307/590] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.896985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:54.910626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee94bd0-fc26-41ca-82dc-7e66f1c540f8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:54.954782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:54.955431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:54.955945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:54.956077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:54.964686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:54.966146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:54.981422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:54.982463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:54.983961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 284/591] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:54.984826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.020120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.020654 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2516-536b-490b-b063-34016a1a17c8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.052676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.069831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.070980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.071472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.071954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.073233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:55.074327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.076322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.096176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 308/592] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:55.097730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.116128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b8c25-d4ba-498b-9049-4ce2d0f128f5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.168740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.169613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.170047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.171458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.172494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:55.173099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.175187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.191386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 285/593] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:55.192412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.230535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ed488-dcc7-4a6b-bd8f-9795d15745cc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.269951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.270968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.271489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.271967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.272991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:55.273531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.275175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.292981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.297966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 309/594] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:55.299053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.302775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bb6d-e154-4438-ad78-53df8a50e0d6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.337579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.338576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.338950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.339312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/bfd0c9fabb1040cd9055b16f3504301f/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.347170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.356242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=bfd0c9fabb1040cd9055b16f3504301f, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.358458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.380786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 286/595] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:55 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/bfd0c9fabb1040cd9055b16f3504301f/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:55.381975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.419795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d453f-104e-4672-8e53-8397b1f8c3ce None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.460328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.461451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.461973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.462471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.471848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.473687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:55.488242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:55.489279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:39:55.490231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:55.492929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 310/596] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:55.504311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.576080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7d482-541d-41a7-9c7b-8505998bc23c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.632880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.633670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.633954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.634227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.649985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.652069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.654511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.670840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:55.672983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:55.674052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:55.675116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:55.675116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:55.675116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:55.675116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:55.675116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 287/597] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:55.676071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768e4b-7abe-4d1e-a344-10c00dfa0f7f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.682081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.717144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.719186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.719466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.719738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.720635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:55.720940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.722419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.743130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 311/598] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:55.748724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.850123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315a8b7-6da0-44f2-be5c-f5e95d613be8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.914243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8819e-291c-4c4e-b628-7ce841dbf363 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:55.926371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.927004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.927285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.927707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.928445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:55.928756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.930157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdc8d8-db88-4be3-9c49-8858789d3373 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.951367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 288/599] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:55.953392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277822a6-6c2d-4aa0-a281-98af7e3e8478 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.953683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277822a6-6c2d-4aa0-a281-98af7e3e8478 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.953964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277822a6-6c2d-4aa0-a281-98af7e3e8478 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.955690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 289/600] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:55.956625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277822a6-6c2d-4aa0-a281-98af7e3e8478 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:55.957004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:55.957750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.958125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.958510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:55.970645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:55.972388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-b7971495-2dbe-482d-94dd-ed0bb762c5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:55.989815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:55.990972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:55.992076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:55.992076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:55.992076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:55.992076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:55.993752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 312/601] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:55.995256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:55.995633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:55.995998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.016369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:56.017798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:56.020240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.031026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.089160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277822a6-6c2d-4aa0-a281-98af7e3e8478 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.096092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 313/602] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:56.097035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.126109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.126758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.127035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.127308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.135341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.136826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:56.149791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:56.150677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:56.151968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 290/603] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:56.152485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.212854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd0ce-053c-45bd-adb0-160dd9e22e6b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.250477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.251234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.251607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.251882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.253017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:56.253588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.255712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.258671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d091941c-4ac7-4dae-9f73-2596e2a76ae0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.263899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.276308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 314/604] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:56.276308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.280750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.306643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.307290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.307568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.307841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.321114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:56.328453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:56.329407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:56.330243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:56.333226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 291/605] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:56.334141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.401848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275456d2-fbb5-4eff-8903-e73fc7172aa5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.438143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.438954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.439361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.439733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.440832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:56.441006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.442544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.456624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 315/606] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:56.457492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.467508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3c39b-1860-4007-9311-cf3ec727a769 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.514943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.516104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.516960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.517380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.519211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.527661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.530212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:56.547059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:56.548141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:56.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:56.551961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 292/607] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:56.552889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.576412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c3f5-4837-4269-b186-693ebf48ffb3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.598409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.613861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.614653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.615041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.615421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.616248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:56.616708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.618170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.630228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 316/608] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:56.631057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.694705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce54d7c-ef5b-457c-9a75-ddeca48718ae None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.731200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.732263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.732916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.733978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/117a0317f7994b59a6a23786c9155399/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.751649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=117a0317f7994b59a6a23786c9155399, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.753491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.753623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bc7b4-d6a7-4c60-90f4-1092bddbe87b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.769718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 293/609] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:56 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/117a0317f7994b59a6a23786c9155399/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:56.770970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.778548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.798011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.798661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.798948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.799227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.800021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:56.800843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.801923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.817060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 317/610] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:56.826286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:56.883324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:56.890059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aab201-0bc0-48f4-92e5-c4df5190f852 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:56.928928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:56.929684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.929970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.930247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:56.941975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:56.943635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-777d9911-d464-434a-b165-1ef7cbd7b503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:56.986144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:56.987052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:56.987930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:56.987930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:56.987930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:56.987930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:56.991025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 294/611] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:56.997633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91639d41-db79-4140-b12e-e09d63fba8c9 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:56.998222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91639d41-db79-4140-b12e-e09d63fba8c9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:56.998741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91639d41-db79-4140-b12e-e09d63fba8c9 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.005141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 295/612] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:57.006538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c494b-c05d-4319-997c-6fb7b6c81802 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.007005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91639d41-db79-4140-b12e-e09d63fba8c9 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.046322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.049445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.049445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.049445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/9fc7adc92a5b41bea6a0929eadc50689/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.069085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=9fc7adc92a5b41bea6a0929eadc50689, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.070684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aed9b4-9e99-400f-99ae-87ec1145f88a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.088207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 318/613] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:56 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/9fc7adc92a5b41bea6a0929eadc50689/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:57.089662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.089950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.090272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.113915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:57.115575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:57.165051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:57.172551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91639d41-db79-4140-b12e-e09d63fba8c9 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.249815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.250774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.251039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.251312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.252030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:57.252355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.253831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.256656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:57.268447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 319/614] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:57.270123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 296/615] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:57.280716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.296704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.451349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf792112-6f12-41cf-8ff5-922feff60afb None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.466062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207cd6-c328-4cc9-8b8b-6ed4115f85cf None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.517733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.519244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.520485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.521578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.535459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.536628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.537886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.540205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.542870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:57.553472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:57.554411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:57.555243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:57.557101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.560085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.566459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 297/616] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:39:57.569131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:57.578202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:57.579124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:39:57.580040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:57.583884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 320/617] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:57.597512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.622241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:57.705369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:57.714119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044ce3a-c03d-4968-b57c-ee870ec3be68 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.753804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.754840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.755327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.755886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.756970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:57.757512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.759246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.779046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 321/618] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:57.784691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.798453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd059056-b588-45d9-b633-aa42434eacc8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.833051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.833539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.833823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.834097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.834812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:57.835118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.836527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e481a3db-f938-4f48-81bd-4c10f5f0a7c0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.846564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 298/619] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:39:57.851865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8316ae-5b9f-4db0-b3fb-0c281476c825 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.851865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8316ae-5b9f-4db0-b3fb-0c281476c825 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.851865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8316ae-5b9f-4db0-b3fb-0c281476c825 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.853925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 299/620] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:57.854925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8316ae-5b9f-4db0-b3fb-0c281476c825 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:57.881920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:57.909378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358cb1b-c5cd-416c-9f83-5de2ace0853a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.946113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364423ce-693d-40f7-a565-91add98837ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:57.947150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364423ce-693d-40f7-a565-91add98837ad None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.947628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364423ce-693d-40f7-a565-91add98837ad None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.948204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364423ce-693d-40f7-a565-91add98837ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.960600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364423ce-693d-40f7-a565-91add98837ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:57.962374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8316ae-5b9f-4db0-b3fb-0c281476c825 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:57.963233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364423ce-693d-40f7-a565-91add98837ad None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-364423ce-693d-40f7-a565-91add98837ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:57.979647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:57.982283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:57.984998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:57.984998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:57.984998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:57.984998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:57.985892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 322/621] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:57.987258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:57.987447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:57.987688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:57.990557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.008192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:58.008908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.009687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.009976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:58.010168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.010548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.022513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.024114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:58.039460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:58.040446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:58.041513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:58.041513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:58.041513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:58.041513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:58.047597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 300/622] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:58.048727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.085924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 323/623] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:58.087072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.150216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.162148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d2d2a-9669-45c1-b57d-4131a1206ec8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.197357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a907dd-2dac-4d54-a3ed-779d08c604b2 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.197583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.198231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.198618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.198999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.199909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:58.200345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.202434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.220919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 301/624] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:58.222160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.238858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.239761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.240182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.240619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.241574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:58.242119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.243658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.254677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.258219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 324/625] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:58.262622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.366161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d8a2e-c8a9-4395-8276-4bd7b3274ced None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.376743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8455-ae15-43b1-b2c4-d892c27068be None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.398287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.414092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.414970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.415230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.415488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.415875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.416346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.416951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.417360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.423711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.425567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.429872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:58.435197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:58.436885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:58.437869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:58.440203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 302/626] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:39:58.440675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:58.441673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:39:58.442736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:39:58.443778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.448448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 325/627] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:58.449366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.562858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.573988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8dab-8bf3-463f-8508-3cc2a5d63f2c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.575645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458979f-c0e9-4838-975c-b9c4e07eaacc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.610544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.611653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.611653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.612195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.620335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.621027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.621809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.622089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.622478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.622893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.624362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:58.625083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.627180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:58.635615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:58.636727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:39:58.637834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:58.639172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 326/628] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:58.640388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 303/629] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:58.644269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.645563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.757970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52d3c9-a186-41ac-9ddb-9a90a79bd2c5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.782382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f50109-4a04-46f6-a941-07c16b6e8190 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.803766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.805101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.805477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.805828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.817952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.819516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.822981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.823810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.824302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.824755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.825682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:58.826179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.828926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:58.835039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:58.835909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:58.836798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:39:58.836798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:39:58.836798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:58.836798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:58.836798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 304/630] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:58.837784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.843060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.850896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 327/631] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:58.851954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:58.952553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe047a9-d71d-4bf2-b2b2-4574e095dc0b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.964610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69576d-b9d5-4202-888f-5500a0c38b3f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:58.966443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:58.991075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:58.991804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:58.992191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:58.992582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:58.993464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:58.993843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:58.995931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.007128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.008056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.008535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.008983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.009957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:59.010448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.011979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.024279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 328/632] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:59.025312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.037519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 305/633] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:39:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:59.038458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.109545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.139370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ff0eb-6741-43e1-a01c-4df430348fbf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.158950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff60f4e-eb48-4a63-94e6-5bca85ed2a2b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.176373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.177123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.177323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.177599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/8d2a9820c2314fd8acbf6739408980af/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.193294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=8d2a9820c2314fd8acbf6739408980af, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.194728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.194936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.195569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.195846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.196116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.205213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.206710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.208406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 329/634] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:39:59 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/8d2a9820c2314fd8acbf6739408980af/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:39:59.216497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-684341a0-74ed-452c-8d67-f52946e46bff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:39:59.220838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:59.221874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 306/635] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bc9a-f4fc-4235-8971-5ca1a81089f2 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.229039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bc9a-f4fc-4235-8971-5ca1a81089f2 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043bc9a-f4fc-4235-8971-5ca1a81089f2 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 307/636] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0255d-5260-4cde-8d48-bc30c7b0e6f3 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0255d-5260-4cde-8d48-bc30c7b0e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0255d-5260-4cde-8d48-bc30c7b0e6f3 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 308/637] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:39:59.231093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0255d-5260-4cde-8d48-bc30c7b0e6f3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.240366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.338417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dc919-e19f-4b16-b498-28b6f9db03e4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.355349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0255d-5260-4cde-8d48-bc30c7b0e6f3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.379400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.384846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.385489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.385778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.386057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.399669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.400651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.400931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.401201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.402254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:39:59.403024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.405300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505bbaa-a1f7-4c39-b698-9e4502017a57 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.434467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 309/638] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:39:59.434467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2e18-f57b-4fea-bd2d-5f8e8b401083 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.434467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2e18-f57b-4fea-bd2d-5f8e8b401083 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.434467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2e18-f57b-4fea-bd2d-5f8e8b401083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.453426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-eeca2e18-f57b-4fea-bd2d-5f8e8b401083 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:59.454634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-eeca2e18-f57b-4fea-bd2d-5f8e8b401083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:59.457923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.459309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.475362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.536429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 310/639] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:59.538063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.538538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.538998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.559397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:39:59.560888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:39:59.572266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 330/640] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:59.573320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.648311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 311/641] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:39:59.648311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.685057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff64bfc-a5df-41c2-9a7b-ce91e535af09 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.689367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.702003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.724691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.725330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.725530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.725806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.757899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffbb5b-2e7b-4d87-a67c-f94379d60b57 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.793678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.794329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.795220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.795502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.798335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.799783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.805797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:39:59.811251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:39:59.812186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:39:59.813056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 312/642] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:39:59.813726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.920446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 331/643] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:39:59.920446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:39:59.923425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.928331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310c611-cd41-4bd6-834d-586cac82c888 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:39:59.931679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:39:59.970296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:39:59.971071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:39:59.971423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:39:59.971770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:39:59.982225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:39:59.983718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:39:59.999215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.000389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 313/644] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.006002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.030016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbac47a-f2b4-4def-ac66-595eb3dc718e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.069063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.069816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.070100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.070377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.080646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:00.085496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.086434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 332/645] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:39:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.087411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.115111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb59322-8cf4-4bd7-a891-f47f1b449b48 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.156770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.157468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.157807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.158135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.158926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:00.159290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.160790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.167207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.168620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 314/646] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:00.169407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.191482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.205045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c6252-c0b8-4967-a325-dd1660854712 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.242147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.242803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.243087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.243358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.254670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.256561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:00.273161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.274091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.275030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:00.275030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:00.275030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.275030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:00.275030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 333/647] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.275308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.286055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb419-4800-4eec-931d-d942ca19d323 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.322263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.323277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.323766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.324256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.325222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:00.325539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.327143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.347385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 315/648] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:00.347385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.395459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561acb73-62f1-4b27-a638-789da5571b8a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.419780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.428009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.433547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.434174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.434457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.434734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.435846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:00.436159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.437872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.446859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 334/649] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:00.447558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.463206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6097c-cb94-4574-986a-d9576358f35a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.499417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.499986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.500274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.500582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.510840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.512339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:00.526980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.528052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 316/650] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.528965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.562364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb76e1-6ca0-4fa9-80b9-8928c71e31bd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.598459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.599107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.599508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.599787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.600621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:00.600928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.602287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.620369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 335/651] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:00.620369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.639064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094585a-e67b-4403-8e52-bdf832c9694b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.663417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.668003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.677003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.677653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.677962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.678216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.685018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.686509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:00.697768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.698639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 317/652] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.704629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.733461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bf131-fd56-4b3f-9ca2-9ff4609bbbd2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.769433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.770013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.770303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.770580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.781437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.782884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:00.798332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.799315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.800213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:00.800213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:00.800213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:00.800213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:00.800213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 336/653] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.801088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.810618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afb0b9-2df6-4845-9e94-258dfed07b9a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.852955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.853580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.853862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.854197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.854869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:00.855175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.856614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.873459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 318/654] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:00.873459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.905894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.910297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f6602-b17a-41cc-9a57-83cf5e7b67a3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:00.921133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:00.946592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:00.947333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:00.947623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:00.947901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:00.955698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:00.957175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:00.970381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:00.971258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:00.972158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 337/655] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:00.972691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:00.981870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3f3cf-05d0-4b7f-b511-83d8945f2fbe None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.016747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.017372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.017651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.017925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.018725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.019009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.020521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.032243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 319/656] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.033058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.082480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0d925-9ecc-43f5-9f10-30030de9c9b3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.118915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.119889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.120353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.120779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.121645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.122110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.123712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.134567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805cf3d-0b1c-44cc-b105-bd83581820bd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.136098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.147027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 338/657] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.147874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.168347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.178335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.178986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.179334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.179535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.187960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.189445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:01.200827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:01.202338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 320/658] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:01.203864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.261868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213a9ff-6a67-413c-a3b1-9123cd2fe212 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.298581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.299120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.299401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.299676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.300453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.300760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.302191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.310127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8f6bc-a2b9-4f34-a3a7-b87470faddc8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.313748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 339/659] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.314460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.344948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.345567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.345840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.346140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.346933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.347244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.348694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.354538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 321/660] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.355305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.388796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.408338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.433693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4ad59-9c7c-4b93-a073-39d08ff9cb06 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.472004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4110b-308d-48af-abdb-714cce279f0f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.473209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.474084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.474568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.474962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.484373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.485932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-457e7290-3f67-4753-acda-0508f54eb2b7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:01.499150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:01.500419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 22:40:01.501628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:01.506219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 340/661] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:01.507421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf613bf-7925-4b08-ae58-0555f0a434e1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.507710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf613bf-7925-4b08-ae58-0555f0a434e1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.507987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf613bf-7925-4b08-ae58-0555f0a434e1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.511789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.512375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.513152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.513152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.513397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 341/662] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:01.514377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.514688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.514789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf613bf-7925-4b08-ae58-0555f0a434e1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.516513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.538267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 322/663] 10.222.0.59 () {56 vars in 1139 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.538978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.632260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.644536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf613bf-7925-4b08-ae58-0555f0a434e1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.649128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04124e0c-e01b-40b9-b130-478d32d3b006 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.682961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.683818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.684253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.684687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.685639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=bfd0c9fabb1040cd9055b16f3504301f) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.685773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.686392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.686674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.686832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.686945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.687728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:01.688035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.688824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0824e-d08a-4d16-99f7-a9e5ed6ac6d7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.689499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:01.695665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 342/664] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/role_assignments?user.id=bfd0c9fabb1040cd9055b16f3504301f&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.697089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.697367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.697635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.704555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.718739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:01.724241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:01.725149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 323/665] 10.222.0.59 () {56 vars in 1137 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:01.726306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.812862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 343/666] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:01.814088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:01.852619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e59d-6636-43d6-bfef-590c1367c06f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.899562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.900413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.900695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.900972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.919421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:01.949163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce617d-b539-471f-88c2-52f30bf0f9c0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:01.990926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:01.991993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:01.993117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:01.993571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:01.995332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:01.997141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.031062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.084311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.086289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.117497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 324/667] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:40:02.118489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.169983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.224525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 344/668] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:40:02.225392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.233254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bdaf6c-4b6f-4969-9bae-2084bb6beda6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.265703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.270760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.271586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.271964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.272380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.289767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:02.295803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:02.296952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:02.297974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:02.304675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 325/669] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:02.305806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.338850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba91b77-37a9-474c-9a52-3d3c76dedbf8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.380120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.381159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.381559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.381918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.396302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.398186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:02.418195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:02.419556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 345/670] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:02.421192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.427036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b352-193e-41b6-865b-879ab8d39e53 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.430670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.470575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.471226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.471502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.471774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.485050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.486926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:02.506978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:02.507937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:02.508859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:02.508859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:02.508859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.508859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:02.508859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 326/671] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:02.509565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.530187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.553006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d3c9d-1221-4867-aa30-d27ac3f29ee3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.596889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.597508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.597827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.598521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.598953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:02.599263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.600781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.609923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 346/672] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:02.610736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.636656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c5136-06d7-476b-bf5a-260e0b74af5a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.673710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.674682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.675196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.675677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.676717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:02.677305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.678919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.696143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 327/673] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:02.697870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.718146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.721186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e69cfd-0c30-414d-8e8d-2175c550c2d6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.757347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.757969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.758231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.758508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.759191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:02.759491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.761276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.773731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 347/674] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:02.774624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.783575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.810762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f365b94-cc98-4466-9ac6-282c5248b0d7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.848599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.849105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.849670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.861186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.863212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:02.885699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:02.886788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:02.887761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:02.887761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:02.887761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:02.887761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:02.894761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 328/675] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:02.894761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:02.898570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995dcc1f-de88-4401-8a89-a3ea55438060 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:02.949573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:02.950863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:02.951854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:02.952456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:02.962788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:02.964595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:02.974818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:02.977189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:02.978098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:02.978986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:02.983888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 348/676] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:02.985358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.023406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93b799-d216-48be-8db9-eedb63d48cbd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.056820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.074911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.076320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.077079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.077574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.086845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.089423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.094800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1b7c1-225a-4429-ad85-aa8990ca10d8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:03.104519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:03.105448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:03.106359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:03.110326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 329/677] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:03.111351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.139296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.139985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.140263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.140615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.141364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.141669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.143266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.160010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 349/678] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.160010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.232092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a2f46-1e57-4484-923d-17ecb1407122 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.260695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.263586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875119b-a099-447e-acc3-6071c08055e6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.269895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.270806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.271291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.271784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.272873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.273408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.275064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.291220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.293835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 330/679] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.295860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.303617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.304567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.305227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.305965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.307763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.308665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.312231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.329240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 350/680] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.330476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.401709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733f33-8728-422e-bb88-6b71f4ab8010 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.437870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45281c-99b9-421b-8734-65cfd362d588 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.438427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.439060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.439432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.439796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] PATH_INFO: `/v3/users/swift` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.448012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.449717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:03.463311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:03.464526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:03.465464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:03.468492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 331/681] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:03.469693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.478498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.479426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.479426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.479685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.480492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=9fc7adc92a5b41bea6a0929eadc50689) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.480805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.482337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42ad47-b3f5-48cc-a9fd-3b2dcdfad578 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 351/682] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/role_assignments?user.id=9fc7adc92a5b41bea6a0929eadc50689&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db42b9-3d47-4837-8f5c-aa70f318a4f1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db42b9-3d47-4837-8f5c-aa70f318a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db42b9-3d47-4837-8f5c-aa70f318a4f1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 352/683] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:03.495209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db42b9-3d47-4837-8f5c-aa70f318a4f1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.537210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.575037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.599020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeb4ec-3829-4a02-b2d5-786d9310dbff None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.645096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.645729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.646002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.646268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.647064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=117a0317f7994b59a6a23786c9155399) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.647391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.648867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccbd7be-27cf-4f14-a65b-3df4f20c5417 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.651684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db42b9-3d47-4837-8f5c-aa70f318a4f1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.659637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 332/684] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/role_assignments?user.id=117a0317f7994b59a6a23786c9155399&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.660899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.661180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.661454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.681026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:03.682257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:03.697782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.698814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.699159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.699503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.700715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:03.702368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:03.703934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:03.731478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 353/685] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:03.737559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.772932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 333/686] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:03.796993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:03.848667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.884511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826543-2f00-4701-b49a-c2e0649b5a85 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.898703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:03.926070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d2f933-e5df-462d-8e2d-cde11a1d19f2 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:03.937662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.938597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.939060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.939524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.976952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:03.977718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:03.978148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:03.978424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:03.992409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-94f09614-809d-408a-a84c-053d1f664781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:03.997160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:03.998128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:03.999027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 334/687] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:04.000687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4914-8a6c-49bc-bbdc-7aaaf24434c5 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.000885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4914-8a6c-49bc-bbdc-7aaaf24434c5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.001113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed4914-8a6c-49bc-bbdc-7aaaf24434c5 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.002613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 335/688] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:04.008333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed4914-8a6c-49bc-bbdc-7aaaf24434c5 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.031745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.033980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8908-deee-4d74-ad29-08c59b9cea1f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.130909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed4914-8a6c-49bc-bbdc-7aaaf24434c5 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.135225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.175767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.176497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.176776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.177046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.180336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:04.180336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.180336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.183208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 354/689] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 22:40:04.184677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067151-c449-4975-b2f1-403643499cea None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.185134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067151-c449-4975-b2f1-403643499cea None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.186143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1067151-c449-4975-b2f1-403643499cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.204336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 336/690] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:04.204336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.215499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-b1067151-c449-4975-b2f1-403643499cea None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:04.217067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b1067151-c449-4975-b2f1-403643499cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:04.225313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.288247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 355/691] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:04.297140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067151-c449-4975-b2f1-403643499cea None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.312521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1b493-0e02-4733-99fd-7670b8281611 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.355227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.355982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.356357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.356696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.368836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.370584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:04.394143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:04.395100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:04.395991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:04.395991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:04.395991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:04.395991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:04.400958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 337/692] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:04.402004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.422674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.449518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1067151-c449-4975-b2f1-403643499cea None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.515843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ebf70b-9fa7-46ce-ab85-5f093b16ce73 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.555286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.556245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.556882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.557338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.558164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.559765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:04.573012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:04.574150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:04.575015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:04.577770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 338/693] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:04.578839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.639553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.640526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.640967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.641404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.650928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.656160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.658300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.675454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:04.678562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:04.679449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:04.680382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:04.680382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:04.680382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:04.680382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:04.684417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 356/694] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:04.685543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.708793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca759e9-a0c5-43bf-aab5-b2529e98a834 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.749496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.750540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.751045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.751520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.752487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:04.753038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.754622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.771103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 339/695] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:04.772255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.826465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c3eed-9aec-455a-ab34-4806ec8794c0 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.868695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.869879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.870406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.870886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.871856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:04.872419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.874842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.885896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 357/696] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:04.887048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:04.888247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0fcce-af73-40c0-9cef-c66cf91df871 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:04.933298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:04.933932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:04.934215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:04.934486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:04.935578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:04.935882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:04.937858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:04.948823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.952764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:04.956391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 340/697] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:04.958250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.005663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7386-2e75-43cb-9456-6e1b4f8d5717 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.043341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.043984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.044278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.044579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.052551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.053966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:05.066383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:05.067301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:05.068635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:05.072469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 358/698] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:05.073379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.095168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf4ba7-7df1-49c1-9024-da9eb7d3948a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.195233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928273b-e1a8-4a68-9f4a-fd6b40d42748 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.211233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:05.235750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.236433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.236716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.236988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.245473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.247280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:05.261192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:05.262201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:05.263185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:05.270477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 359/699] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:05.270477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.298810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.299981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.300535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.301332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.302517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:05.303032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.305406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.313004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 341/700] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:05.314108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.444244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90254c8-f8cc-4768-b82b-4ee578f8dc61 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.484770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.485404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.485692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.485971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.486829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:05.487785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:05.488122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.489877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.506392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 360/701] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:05.512600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.528932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218214f8-9eac-4706-be8c-c4e2ba8b4832 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.551220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:05.566355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.567354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.567863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.568384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.569397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:05.569911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.571571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.595653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 342/702] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:05.597212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.627027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1add-1941-4d45-b780-9957380a73cc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.666496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.667118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.667395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.667667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.668598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=8d2a9820c2314fd8acbf6739408980af) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:05.668903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.670569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee454ed-a5c1-47fc-8cb3-e29d02951d7b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.677251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 361/703] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/role_assignments?user.id=8d2a9820c2314fd8acbf6739408980af&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:05.708335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93664-8bc3-492a-9a95-f62b32db1bd8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:05.735399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:05.748704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:05.749342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.749625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.749904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.761274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbaf36-2591-4faf-a80b-451fe65963ed None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.761589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbaf36-2591-4faf-a80b-451fe65963ed None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.761854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbaf36-2591-4faf-a80b-451fe65963ed None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.764267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 362/704] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:05.769563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:05.769862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:05.770116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:05.800597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:05.801857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:05.824322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:05.825822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:05.916048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 363/705] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:05.938451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.938821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 343/706] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 22:40:05.943243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:05.971417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:05.973489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.068250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63316b-3877-4e74-9378-cfe12548224d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.068875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faae0c0-5417-4274-a0a4-dfd745c6bc45 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.112412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.112623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.113072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.113270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.113388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.113576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.113684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] PATH_INFO: `/v3/services/network` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.113857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.114220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.115993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1cca1099-799a-4bb4-bff4-1f8cd8a5cb7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:06.129429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:06.130395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:06.131231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:06.133055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 364/707] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:06.135609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0657-911a-43e4-9177-0ab97df2826a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.135609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0657-911a-43e4-9177-0ab97df2826a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.135609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab0657-911a-43e4-9177-0ab97df2826a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.136141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.137192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.137649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 365/708] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:06.138377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0657-911a-43e4-9177-0ab97df2826a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-8b41c2e2-0f4e-491d-afa9-49e304bd62c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:06.158054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:06.160229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 344/709] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.162389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.187871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:06.189560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:06.243282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.255354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab0657-911a-43e4-9177-0ab97df2826a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.291119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.291897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.292250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.292606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.293533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:06.293905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.296015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.296384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 345/710] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:06.297567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.301420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 366/711] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:06.301558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.306608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.432471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec331e-caec-4a52-a719-ec5c1e5dbd52 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.435987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebf23b-6eb1-40f9-8d59-50ff0c3527b8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.475365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.475705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.475988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.476159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.476344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.476501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.476658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.476816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.477292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:06.477457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] RBAC: Adding query filter params (type=network) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:06.477603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.477746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.478947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.479126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.492641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 367/713] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:06.493272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 346/713] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:06.493705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.501566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.549370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.656108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c7296-5e9f-456e-a7b6-80f804e92574 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.671696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.704983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.705641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.705913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.706178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.721872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.723364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.742164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653848-8cef-456f-8e6a-96dfaab9e7f6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:06.746895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:06.747887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:06.749769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:06.749769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:06.749769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:06.749769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:06.756737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 368/714] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:06.758859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.789428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:06.790127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:06.790408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:06.790680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:06.798595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:06.800186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:06.814400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:06.815350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:06.816248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 347/715] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:06.821282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:06.854276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:06.912615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2c833-7115-42c6-a732-62e8f6976d21 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:06.991663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4fcf3-c75b-47df-b936-acfb8cac92d1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:07.001607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:07.002191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.002479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.002763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.003474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:07.003785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:07.005199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:07.018072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:07.032168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:07.033215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.033674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.034124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.035049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:07.035532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:07.037196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:07.038658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 369/716] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:07.049311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:07.055849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 348/717] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:07.061650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:07.226782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6953ff9-8a5b-4e68-bbaf-ae86112f10aa None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:07.245013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d914d-f39d-4f18-baf3-387d62171646 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:07.290768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:07.291299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.291576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.291838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.292649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:07.292953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:07.294371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28738e-3da4-4728-858f-f31f984423e2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:07.297552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:07.304518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 349/718] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:07 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:07.308554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:07.308554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.308554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.308554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.308884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:07.308884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c521c2-5a9e-4c6f-b311-db580ad228ba None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:07.352622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 370/719] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:40:07 2022] POST /identity/v3/users => generated 254 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:07.766800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1e570-c8ee-4d65-a006-b97d880558dd None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.767201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1e570-c8ee-4d65-a006-b97d880558dd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.767397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1e570-c8ee-4d65-a006-b97d880558dd None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.768986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 350/720] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:07.774195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71634bb-0fd8-4b15-90df-b4587fbfbe36 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:07.774642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71634bb-0fd8-4b15-90df-b4587fbfbe36 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:07.774718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71634bb-0fd8-4b15-90df-b4587fbfbe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:07.794329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c71634bb-0fd8-4b15-90df-b4587fbfbe36 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:07.795642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c71634bb-0fd8-4b15-90df-b4587fbfbe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:07.874958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 371/721] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 22:40:07.897189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1e570-c8ee-4d65-a006-b97d880558dd None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:07.959167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:08.024881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1e570-c8ee-4d65-a006-b97d880558dd None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:08.060950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:08.061722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.062058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.062330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.063040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:08.064571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:08.070236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3938f-f2b4-4537-a344-deb36faadfe5 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.070525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3938f-f2b4-4537-a344-deb36faadfe5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.070802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3938f-f2b4-4537-a344-deb36faadfe5 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.074707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 372/722] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:08.078442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.078729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.079011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.091961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 351/723] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:07 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:08.101157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:08.102489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:08.218337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 373/724] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:40:08.253706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:08.369159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265dde2e-940f-4c9d-a901-8dcdcd86467a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:08.379316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:08.407432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:08.408408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.408864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.409311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.421748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:08.427362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:08.428272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:08.429173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 352/725] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:08.439488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:08.493038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:08.561596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51e61e-ec65-4a4a-a0df-280529b382dd None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:08.605019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:08.605650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.605929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.606204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.606935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:08.607779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:08.609175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:08.624531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 374/726] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:08.630062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:08.788005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a2ce-5fdf-4976-9696-138804aa2bbb None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:08.836988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:08.837642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:08.838190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:08.838471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:08.854243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:08.855753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:08.872364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:08.873321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:08.874316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:08.874316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:08.874316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:08.874316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:08.875965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 353/727] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:08.881368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.022721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837298a-21dd-43e3-b1a5-41bb0b1e20b2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:09.030272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:09.061563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:09.062196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.062487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.062767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.063535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:09.063846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:09.065233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1129baa-0f05-4423-a1c8-966d9deef897 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:09.089650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 375/728] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:09.095729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.113197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5478-a0b7-455e-8e1f-25ac3f5ce991 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.113489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5478-a0b7-455e-8e1f-25ac3f5ce991 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.113751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f5478-a0b7-455e-8e1f-25ac3f5ce991 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.115349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 376/729] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:09.120217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.120536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.120815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.144642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:09.147198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:09.148425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:09.300500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 377/730] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 22:40:09.303402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cb11-4c78-4a95-8266-549c382548d5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:09.355927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:09.356598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.356880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.357179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.365260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:09.366707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:09.371330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:09.386664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:09.387609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:09.389097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 354/731] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:09.396167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.544236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:09.551134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a48503-7959-4e5d-bf80-a74f6044421a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:09.556627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:09.594528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:09.595224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.595508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.595786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.596583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:09.597947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:09.606979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8fe55-1ec3-4c5a-aa0e-d99b73d80cc0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:09.629696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 378/732] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:09 2022] POST /identity/v3/services => generated 240 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:40:09.685193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:09.686683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.687120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.687453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.688699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:09.688699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:09.690091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f69fa-061d-4afa-9db1-b2bfc02aedd7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:09.718787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 355/733] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:40:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:09.724597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.736771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb8ed-a488-47be-986e-d26de4d89c6d None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.737108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb8ed-a488-47be-986e-d26de4d89c6d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.737326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aeb8ed-a488-47be-986e-d26de4d89c6d None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.738714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 356/734] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:09.751046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.751402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.751671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.798724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:09.799974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:09.868979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e34ed-396c-4e16-9a05-7a77c73e0fe1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:09.905977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 357/735] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 25 22:40:09.919035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:09.920195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:09.920516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:09.920789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:09.937691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:09.955520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.019260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.020749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.053655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.144000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 379/736] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:10.145519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.174223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e08f7e-1688-40cd-bc3e-37771d676bf5 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.207948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.231327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.232135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.232964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.233243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.244538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-0882f71e-8108-430c-ab77-3e90032c75be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:10.249836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:10.250763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:10.252178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 358/737] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:10.253811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f7f-4fed-4d3a-afd9-673ee805860e None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.253811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f7f-4fed-4d3a-afd9-673ee805860e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.253811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e355f7f-4fed-4d3a-afd9-673ee805860e None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.258618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 359/738] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:10.259513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e355f7f-4fed-4d3a-afd9-673ee805860e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.265162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93a99-ba9b-42d1-92f9-cd6a5d9677f2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.308176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.309174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.309730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.310011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.323327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.324962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3d7a1f95-1e38-4f3a-9b54-74e40412371a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:10.341374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:10.344003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 380/739] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.346146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.366956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:10.368258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:10.387396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e355f7f-4fed-4d3a-afd9-673ee805860e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.416873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.430513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.431140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.431422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.431699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.432619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:10.432934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.434937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.449193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 381/740] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:10.449643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 360/741] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:10.450544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.450676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.510094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.594157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0b47a-2759-4e06-a92b-7f3b9adf747c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.597805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072da72-5c96-4cfd-87c0-68f9cf57eb6c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.631703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.633015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.633755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.634252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.640613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.641327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.641622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.641907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.642589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:10.642898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.644267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.650937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.653265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.663960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 382/742] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:10.664907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:10.673636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:10.674538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:10.676309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:10.676309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:10.676309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:10.676309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:10.682299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 361/743] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:10.682299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.726006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.772089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.776015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f50cb-377b-4be3-97c2-43095cabd7bd None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.793908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead13d9-2572-43c6-bad1-4ed7706540c0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.812343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.812992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.813276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.813554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.823717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-7b58c274-f4b0-4880-b71d-722325966cb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:10.829633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:10.830746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:10.831609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 383/744] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:10.832389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace08d0-0ff1-4db7-824e-6200f87dd7c9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.832389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace08d0-0ff1-4db7-824e-6200f87dd7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.832532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace08d0-0ff1-4db7-824e-6200f87dd7c9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.834057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 384/745] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:10.834757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace08d0-0ff1-4db7-824e-6200f87dd7c9 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.837420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.838508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.839166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.839616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.849586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.851865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:10.865394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:10.866264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:10.867132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:10.868890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 362/746] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:10.873181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:10.945401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace08d0-0ff1-4db7-824e-6200f87dd7c9 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:10.980480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:10.981340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:10.982143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:10.983186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:10.984123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:10.985082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:10.985394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:10.986770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dd1fe-999c-4ea5-8161-e269df4642e9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:10.990045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f77cbc-9a78-45f0-8540-8d697b0f82d7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.005725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 385/747] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.005725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.005725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.005725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.022668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:11.023877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:11.037423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.038134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.038411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.038680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.039584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.039703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.040103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.041307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.049749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 363/748] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.054887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.102820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 386/749] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:11.104026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.173375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b13457-e30e-4db0-9edb-9aa4e0924fcb None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.209434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.210036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.210325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.210587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.211339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.211648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.213356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.227001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876322ae-8263-45f0-8350-81d35b219c3f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.228830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 364/750] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.230782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.252754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.269682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.270333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.270616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.270892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.280933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.282669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:11.298652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:11.299611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 387/751] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:11.305514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.316645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.331888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7d05f-852c-45fb-a99a-d94e7d84ca6f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.368144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.368909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.369191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.369475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.381488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.382978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:11.400247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:11.401204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:11.402129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:11.402129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:11.402129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:11.402129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:11.403029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 365/752] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:11.403791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.423079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730f8e3-332a-4437-b371-bf3fc26d89bf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.459613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.460265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.460575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.460856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.461490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.463119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:11.472091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:11.473159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:11.474641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 388/753] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:11.475480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.489220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.523052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b4604-c3d7-415e-9b00-86e16e600c22 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.549789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.561274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.561933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.562347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.562627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.563423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=8d2a9820c2314fd8acbf6739408980af) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.563730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.565205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.570829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 366/754] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/role_assignments?user.id=8d2a9820c2314fd8acbf6739408980af&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.571621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.594346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2464826-9a0b-4553-9f2b-38af8164a2bc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.643811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.644831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.645411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.645868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.647601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.648433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.650925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.678665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 389/755] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.678665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.720755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba18cb-0247-4b93-8413-08b153f3d0e5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.771546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.773050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.773413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.773759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.774543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.774921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.776416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.780674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.793707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 367/756] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.795798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.805946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ee297-c7d6-4510-ab67-054ebe33326d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.846871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:11.855407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.856069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.856628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.856920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.858171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:11.858935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.860659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:11.868388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 390/757] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:11.869526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:11.933207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be412908-0d74-480c-85eb-a5a2955f21cd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.973275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:11.973914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:11.974195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:11.974470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:11.977531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10407886-8f0d-4758-a813-cb34a7fa0a44 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:11.985371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:11.986824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:12.002048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:12.003154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:12.004208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:12.004208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:12.004208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:12.004208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:12.004208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 368/758] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:12.008263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.017562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.018204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.018489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.018770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.026568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.028012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f29bd0a0-c10e-470b-a914-88bbaa899042 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:12.040579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:12.041531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:12.042459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 391/759] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:12.043062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae45a-b649-44a9-ba41-87070340c22a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.045244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae45a-b649-44a9-ba41-87070340c22a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.045244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ae45a-b649-44a9-ba41-87070340c22a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.046470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 392/760] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:12.046817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ae45a-b649-44a9-ba41-87070340c22a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.066305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.111348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.127540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824ca19-b8e9-450a-a105-1753b5f4a954 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.162726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.163343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.163625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.163900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.164713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:12.165052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.166498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.169645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ae45a-b649-44a9-ba41-87070340c22a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.176377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 369/761] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:12.176377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.210863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.211486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.211770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.212048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.213033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:12.213342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.214702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dfa62-7575-4322-abb7-6e9f3c0285b4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.227304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 393/762] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:12.228578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.228870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.229144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.246635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:12.247861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:12.293761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028746-087a-434b-8486-741fb5d9d377 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.307616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.317986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 394/763] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:12.318605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.345135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.346054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.346335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.346611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.347443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:12.347750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.349211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.367646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 370/764] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:12.368837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.375330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.438262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d2c83-3e7a-4bdb-8816-b233a5b1f9a0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.474707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.475333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.475614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.475893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.476682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] RBAC: Adding query filter params (interface=public, service_id=dd9e57a88aa54677bb691e0206ccefcd, region_id=RegionOne) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:12.476998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.478406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.479803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9a431-0570-4a58-88fb-55adfbc310c7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.486060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 395/765] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/endpoints?service_id=dd9e57a88aa54677bb691e0206ccefcd&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:12.487360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.525064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.525954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.526379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.526895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.534213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.535814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:12.548136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:12.549307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:12.550366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:12.552371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 371/766] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:12.553315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.586793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.602824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c3733-3e35-4dcf-bee1-ac5a26f96bb6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.611754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.639154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.639759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.640040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.640343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] PATH_INFO: `/v3/services/network` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.640981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.642350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:12.651495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:12.652524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:12.653344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 396/767] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:12.658150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.679101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802253-7b87-4527-a370-c879faa071e0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.720718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.721354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.721751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.721925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.770552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f2f9b-5a16-4d71-b483-1f245991b73d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.801128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.802620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.806649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.807267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.807545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.807815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.808488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.809832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:12.815767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 397/768] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:12.816401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.850029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.860003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:12.934856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089085c-2bd4-4171-9977-5965b4ad136e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:12.963570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 372/769] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:12.963570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:12.982044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:12.982682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:12.982957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:12.983230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:12.984012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:12.986104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:12.987209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.000013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 398/770] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.004984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.086765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2960be-b473-47fa-84bc-b06119d07668 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.103756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.111093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bed0e0-0ffb-4442-9d3d-cdedfae67aa5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.143800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.150746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.151536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.152193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.152610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.153859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] RBAC: Adding query filter params (name=network) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:13.154990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.156750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.159016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.159811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.160100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.160411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.168389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 373/771] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.169572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.172662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.174124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:13.190410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:13.191348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:13.192268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:13.192268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:13.192268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:13.192268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:13.192268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 399/772] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:13.197157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.280270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d63ed-9d6e-4533-adaf-a3418fe0298f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.308036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b73adb-2868-4d8d-8d66-4c339005a07e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.315631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.316327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.316784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.317156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.319522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=0683955d11d0442cae5e9e4d4f973e10, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.321154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.341245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 374/773] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:13 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:40:13.341245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.389602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.390253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.390542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.390818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.391521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] RBAC: Adding query filter params (type=network) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:13.391831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.393315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.414772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 400/774] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.425395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.428773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.472037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68349a83-ebc2-486e-b9d2-edbb36aa1dc6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.474258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.516413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.516413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.516688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.516795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.517454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:13.517761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.519145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.537442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 375/775] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.538369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.643603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db611d70-4750-43b3-8db1-55731466d131 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.659153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe521c-25a3-4ee0-97b4-4572055d4a8d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.680987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.700450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.701127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.701568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.701792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.709128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.710198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.710586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.710832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.711300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.711582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.712394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] RBAC: Adding query filter params (interface=public, service_id=6f21634d31bc469882658a70f939f69a, region_id=RegionOne) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:13.712982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.714346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531cc37-e837-48ac-9839-435644cdf549 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.720248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 401/776] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/endpoints?service_id=6f21634d31bc469882658a70f939f69a&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.721669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958ac4c-8d77-4821-b924-77a5ee7c6be0 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.721959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958ac4c-8d77-4821-b924-77a5ee7c6be0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.722551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958ac4c-8d77-4821-b924-77a5ee7c6be0 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:13.723473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:13.724564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:13.725682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:13.728329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 376/778] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:13.728448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 402/778] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:13.733084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.733561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.733906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.734254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.753799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:13.755266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:13.832387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 403/779] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:13.833258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.844434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:13.859776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58873-0be2-4a19-a253-0dfc625bc8c5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:13.896106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:13.896676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:13.896956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:13.897230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:13.897887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:13.899252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:13.905462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 377/780] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:13.906253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:13.997444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc5eab-7c8c-4dcd-8ff9-aeb64739755d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.000179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:14.079891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84242ed7-a3ba-4f28-b211-097cd6a1f2fe None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.106167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.106800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.107111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.107381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.108138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:14.108470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:14.109901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:14.123029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 404/781] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:14.125434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.128335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.128335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.128335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.128586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:14.149379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:14.154661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:14.155596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:14.156466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:14.159218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 378/782] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:14.169429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:14.219190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:14.259939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7ef86-1fa1-40a4-a5e3-0dff31913cdb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.299881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.300909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.301441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.301916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.302903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=d0fd5b7fad8e4578850502f9cacad2a3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:14.303464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:14.305225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:14.320230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 405/783] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:14 2022] GET /identity/v3/role_assignments?user.id=d0fd5b7fad8e4578850502f9cacad2a3&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:14.325144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:14.329016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c7c3-e07d-408b-800c-6b37efa2763c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.367718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.368397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.368679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.368958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.369696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:14.369999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:14.371406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:14.384340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 379/784] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:14.390266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:14.513940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c61ca-c1f8-4753-858a-538a5b2fa35e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.551667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:14.558660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.559707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.560832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.561325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.581224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:14.583013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:14.605991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:14.607497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:14.608421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:14.608421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:14.608421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:14.608421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:14.611576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 406/785] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:14.616738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:14.768572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f91af-951a-465d-89f0-5bcb60162da2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:14.822841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:14.823856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:14.824387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:14.824865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:14.825830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:14.826336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:14.827905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:14.846592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 380/786] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:14.852218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:14.968273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127e4c-e201-4666-bafa-9ea6254f4a21 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.007669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.009130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.009612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.010086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.018989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.020720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-73e59386-50aa-4d70-a93e-2eee1ccf65ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:15.032961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:15.033901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:15.034839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:15.037412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 407/787] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:15.042627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.071929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.178995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bdf4-d9ce-4786-b5f9-9d664f1cfd7a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.179368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bdf4-d9ce-4786-b5f9-9d664f1cfd7a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.179537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6bdf4-d9ce-4786-b5f9-9d664f1cfd7a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.182403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 408/788] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:15.187378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeca7d4-feae-41dc-88ec-e46228266a4c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.187789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.188075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.188379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.220703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:15.221910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:15.227815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.228468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.228748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.229021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.229823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:15.230128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.231550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.264261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 381/789] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:15.267693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.308744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.367365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 409/790] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 25 22:40:15.390608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.420228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.461362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1b8b3-325a-42e2-8003-3d3629b82318 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.520702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.521347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.521728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.522009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.532564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.534114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:15.549356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:15.550279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:15.551164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:15.551164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:15.551164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:15.551164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:15.551164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 382/791] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:15.559007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.589767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923561b-4434-449a-97e2-f47f91dd87cb None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.651488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.652258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.652564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.652837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.653475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.654986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3bf0f138-17c8-4147-849c-b0fd3a742bbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:15.665026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:15.666012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:15.666829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 410/792] 10.222.0.59 () {56 vars in 1129 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:15.667647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750435-78c6-4cd0-ac17-fff62f143f18 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.667792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750435-78c6-4cd0-ac17-fff62f143f18 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.668042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04750435-78c6-4cd0-ac17-fff62f143f18 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.669844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 411/793] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:15.674929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750435-78c6-4cd0-ac17-fff62f143f18 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.709396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7022d1-ecff-4783-9626-ba8fda6bc32c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.714290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.762865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.764522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.765507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.765971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.767318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:15.768083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.769967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66eccc-c118-4792-9cb6-343d15fc6da0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.787496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.788416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 383/794] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:15.789854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.790333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.790822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.797600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04750435-78c6-4cd0-ac17-fff62f143f18 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:15.812095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:15.814279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:15.843255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:15.843884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:15.844170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:15.844479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:15.845397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:15.846017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:15.848050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:15.856390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 412/795] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:15.858144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.900406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 384/796] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:15.901600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:15.989505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:15.994794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38839f0b-50bf-41c3-a619-20a98ab65b1f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.030041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff590200-e03f-44e2-965d-af4308ed29f5 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.042002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.042658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.042941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.043247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.052726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.054547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.055465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:16.071514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:16.072452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:16.073365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:16.074354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.075212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.076358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.076831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.077837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:16.077942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 413/797] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:16.078439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.078767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.080394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.087029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 385/798] 10.222.0.59 () {56 vars in 1124 bytes} [Mon Jul 25 22:40:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:16.088481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.218221 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312afa32-838c-458e-9d0a-b9b8e57afda0 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.221780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9353646-8c9d-417b-846d-a370a7a15556 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.259741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.260749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.261282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.261736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.262891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:16.263985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.264324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.265073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.265428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.265775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.266458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.278710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:16.279661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 386/799] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:16.280676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:16.288871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:16.289824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:16.290744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:16.298194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 414/800] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:16.299322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.322597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.346852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.404344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06802bc9-d50a-4621-8e70-ef6315b9810f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.409638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b5b-cf72-4f21-8458-6b385411d5da None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.439876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.440590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.440874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.441152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/8d2a9820c2314fd8acbf6739408980af/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.443074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=8d2a9820c2314fd8acbf6739408980af, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.443263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.443863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.444145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.444454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.444562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.445173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.446527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b21d0-cdfa-4804-bc24-998787abe3eb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.468331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 415/801] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:16 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/8d2a9820c2314fd8acbf6739408980af/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:40:16.468331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.483743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 387/802] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:16.486037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1095e8-e645-48a4-95d5-e68933761ad1 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.486444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1095e8-e645-48a4-95d5-e68933761ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.486799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1095e8-e645-48a4-95d5-e68933761ad1 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.489296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 388/803] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:16.494191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.494504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.494753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.516339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:16.518012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:16.585421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.616959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008003-e5ed-4de0-a2f0-a2a6c43e944a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.620873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 389/804] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:16.645395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.672808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.673470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.673754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.674040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.674809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:16.675120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.681550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.701632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 416/805] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:16.707923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.711128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.808141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2650b-4b87-4912-9aa4-7ff84958f098 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.824570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eeeade-da77-490f-8fb6-fa682f1422a1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:16.854312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.854886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.855164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.855433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] PATH_INFO: `/v3/services/network` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.856064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.858093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.868032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:16.868342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:16.869284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 22:40:16.870527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:16.871492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:16.871492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:16.871492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:16.871680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 390/806] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:16.875953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.885405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:16.887333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:16.889970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:16.907976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:16.910130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:16.911325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:16.911325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:16.911325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:16.911325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:16.911325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 417/807] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:16.915398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:16.987132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:16.997644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0898-887c-4aa6-b4f8-4c7d29f478e4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.037714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.038345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.038643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.038895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.039581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] RBAC: Adding query filter params (name=network) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:17.039888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.041393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71621d9d-241a-4301-81c5-f1e896d03fe7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.046912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 391/808] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:17.048185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a377b9-e2cf-4c2a-a307-65449bb26e50 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.052378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a377b9-e2cf-4c2a-a307-65449bb26e50 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.052378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a377b9-e2cf-4c2a-a307-65449bb26e50 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.052378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 392/809] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:17.054368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a377b9-e2cf-4c2a-a307-65449bb26e50 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.065662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4559b-6ea0-4267-a58a-325ae87529a2 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.110360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.111147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.111527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.111895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.112725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:17.113651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.115395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9620d48-d27c-4ef5-a122-c894b951c3f8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.134273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 418/810] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:17.135755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.136132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.136537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.159753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:17.161142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:17.177411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a377b9-e2cf-4c2a-a307-65449bb26e50 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.216172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.216842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.217123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.217398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.218082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] RBAC: Adding query filter params (type=network) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:17.218386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.219767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.225144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 393/811] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:17.225943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.239352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.248774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.265343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 419/812] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:17.266499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.343921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe0cf1-811a-4eda-987b-0a97c30fbe31 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.383429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e499f-5e9f-4ef5-95cb-bb27dd7fad83 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.388440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.389237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.389613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.389985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.400082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.401617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:17.417334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:17.418303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:17.419788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:17.422630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 394/813] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:17.424238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.428766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.429509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.429883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.430254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.431064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.432673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.470166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 420/814] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:17.471620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.525185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.545298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb881a-c7e6-4134-b5f7-cae400038b39 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.553154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.595576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.596688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.597171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.599216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.623582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:17.636689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:17.637670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:17.638580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:17.642431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 395/815] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:17.648733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.683211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7142968-92d7-4b23-802e-81e71ab2020d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.734002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.734638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.734922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.735197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.736004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:17.736325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.737899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.757173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 421/816] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:17.764544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.797564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bbd7d-b1a0-46ac-a53f-926b0918d377 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.842626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.843437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.843956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.844241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.845306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:17.845620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.847018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:17.848925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.859800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 396/817] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:17.864459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:17.875671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:17.878729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbb241-dc02-458c-a092-967ec38be608 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.916773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:17.917412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:17.917780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:17.918124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:17.980300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c7b88-a086-4760-894a-277c125e88e3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:17.989476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:17.991024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.017790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.018492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.018776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.019201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.031341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.032951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:18.051260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:18.052210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:18.053126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:18.053126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:18.053126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.053126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:18.056395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 397/818] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:18.059515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.104658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.114062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 422/819] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:18.115045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.132222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.198131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc1825-f113-43fa-96fd-e7e90b8bb8b1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.244164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb3a5-c3af-4489-9aa9-00be0aa9fb7f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.244682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.245800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.246290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.247659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.248573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:18.249066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.250630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.270524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 398/820] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:18.273080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.290442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.291125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.291447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.291729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.305942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.307708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:18.328136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:18.329104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:18.330178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:18.330178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:18.330178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.330178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:18.330178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 423/821] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:18.334630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.407669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.413105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832618bc-17c3-4fc7-849d-fb3c9b813eac None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.423372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.451127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.451672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.451951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.452222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.459861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.461358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.470274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef72e2-3ea9-43ba-8e70-02422b0d27b7 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:18.473709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:18.474644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:18.475582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:18.479572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 399/822] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:18.480451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.510711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.511701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.512194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.512762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.514332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:18.514891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.516538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.529686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 424/823] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:18.534750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.598847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e663660-c564-4cbf-99bc-c8a7dd812a13 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.634210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.634563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.634761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.635043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.635848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:18.636158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.637637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.648611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06abc7d-9a6e-4d63-b151-75cfa2a25893 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.661240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.661406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 400/824] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:18.662228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.689606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.690660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.691154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.691647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.692470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.699887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.702480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-bcff07b8-4229-4f40-808d-57880c06346f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:18.715035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:18.716729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:18.717827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:18.720458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 425/825] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:18.720458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacd50-d267-466b-89d9-e0709f1737d0 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.720458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacd50-d267-466b-89d9-e0709f1737d0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.720728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dacd50-d267-466b-89d9-e0709f1737d0 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.722316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 426/826] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:18.723977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacd50-d267-466b-89d9-e0709f1737d0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.779645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e894d-3d36-4a6b-9eb6-27cf0c44a4ed None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.814770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.815525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.815804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.816078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.826888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.828364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.833247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dacd50-d267-466b-89d9-e0709f1737d0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-adb6599b-016c-4158-8c98-165998f6e81b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:18.849255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:18.850368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:18.851436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:18.851436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:18.851436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:18.851436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:18.852969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 401/827] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:18.854421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.854666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.854954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.873659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:18.874877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:18.877789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:18.878478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:18.878761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:18.879076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:18.879830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:18.880182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:18.881683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:18.902231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 427/828] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:18.902231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.935751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:18.956360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 402/829] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:18.956360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:18.964248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.018740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b51d-2d4f-4298-95e6-b0ed4034bf0a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.051795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.052448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.052730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.053008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.053698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:19.054005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.054744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a5fe-7306-4908-8d24-96a697c8936f None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.055364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d21f8-3cab-4bb0-9619-d5d8d7ac8069 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.067281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 428/830] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:19.068482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc15-72c9-4cae-875e-64307d160037 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.068773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc15-72c9-4cae-875e-64307d160037 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.069045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3bc15-72c9-4cae-875e-64307d160037 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.070253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 429/831] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:19.070946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bc15-72c9-4cae-875e-64307d160037 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.090222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.090839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.091649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.092003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.092821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:19.093129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.094548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.100235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 403/832] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:18 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:19.101011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.170370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.183481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3bc15-72c9-4cae-875e-64307d160037 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.204275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.224948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.226591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.227057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.227483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.240767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:19.241532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8166f42-cb40-4f50-9b3c-b9a8ace4b9e5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-43ff66fa-c740-410f-b901-1f3c0406c2d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:19.246264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:19.247879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:19.248826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:19.251023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 430/833] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:19.252424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.252711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.252989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.271673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:19.272909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:19.283824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.284511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.284793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.285073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.292749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.294223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:19.306689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:19.307617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:19.308551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 404/834] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:19.309483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.345644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 431/835] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:19.346553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.427951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3e238-fa62-4597-90d3-58b7c047c32e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.446572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.460366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.468962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.470026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.470534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.470991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768af8-c275-495a-a78a-0d4362f1ba96 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.471101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.472368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:19.472900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.474566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.483428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 405/836] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:19.484169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.512590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.513950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.514296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.514657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.515471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:19.515843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.517357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.529912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 432/837] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:19.530808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.596661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a59c4-2293-4ebd-9066-9e6c9420819e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.632758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.633391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.633751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.633944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.634567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.635952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.637335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639b0e4-be87-4387-bee3-50fa9e83aa4e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:19.644997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:19.645999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:19.646812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 406/838] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:19.647601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.680188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.681180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.681622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.681907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.690847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.693203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.694790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:19.711438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:19.712820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:19.713752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:19.713752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:19.713752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:19.713752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:19.713752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 433/839] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:19.714078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.718481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.762299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3cbb8-9da6-42bd-b095-7a2d7b5cd69b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.798099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.798871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.799230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.799576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/d0fd5b7fad8e4578850502f9cacad2a3/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.815627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=d0fd5b7fad8e4578850502f9cacad2a3, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.817089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.823942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b64ae0-47e1-4e31-9de2-edef21abe14b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:19.834023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 407/840] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:19 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/d0fd5b7fad8e4578850502f9cacad2a3/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:40:19.835464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.871112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:19.871757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:19.872039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:19.872903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:19.873604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:19.873913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:19.875335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:19.884353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 434/841] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:19.889930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:19.963799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:19.993987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f6da-6501-4d24-8cbf-1bf9d3a4180e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.005504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:20.017783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f3408-7f23-4c33-ae61-6cf0b5e9b92c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.036886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.037837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.038346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.038824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.039820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:20.040350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.042276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.054184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.054812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.055096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.055370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.056050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:20.056382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.057751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.057956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 408/842] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:20.068312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 435/843] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:20.068510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:20.192365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaaeb02-faf1-4615-ab0c-0ed3bcb3cc39 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.229225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.230148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.230419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] PATH_INFO: `/v3/users/swift` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.239627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.241115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:20.254683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:20.255690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:20.257283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 409/844] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:20.261750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:20.378211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb31a0d-7d25-474c-a1cf-97ea43dc1395 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.398737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:20.414465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.415098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.415382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.415661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.416490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:20.416808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.418238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.437702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 436/845] 10.222.0.59 () {56 vars in 1135 bytes} [Mon Jul 25 22:40:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:20.445360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:20.476479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:20.558422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ee14d-6c84-498f-a235-43c9c3893eef None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.596335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.596967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.597248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.597523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.668402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.670379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.697851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:20.772732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 410/846] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:20.781394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:20.885753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a7060-3108-40fe-8c17-70b6ff36990b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:20.921081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:20.921703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:20.921991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:20.922300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:20.932245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:20.933775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:20.949036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:20.952635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:20.953540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:20.953540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:20.953540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:20.953540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:20.953540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 437/847] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:20.957586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.063553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afd351-05c9-4156-bc7a-571c6deb80ce None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.093988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:21.102301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.102935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.103218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.103495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.104199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:21.104537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.105923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b6d45-9f9d-4cff-9189-b2e4713619b9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.118630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 411/848] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:21.123829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.161773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:21.209050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4d59-f9aa-44a5-83f5-54b1461b0d78 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.209346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4d59-f9aa-44a5-83f5-54b1461b0d78 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.209516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb4d59-f9aa-44a5-83f5-54b1461b0d78 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.211245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 412/849] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:21.216905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.217188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.217463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.234954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f584adb-0eea-4bdc-ae9d-252f50e9e42d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.236857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:21.238919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:21.275913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.276648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.276935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.277211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.285392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.286903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:21.299679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:21.300608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:21.301526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 438/850] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:21.309031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.329340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 413/851] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:21.350983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.413167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:21.425218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aec6a-5aec-498c-b060-c6b310f36470 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.460531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.461483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.462055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.462798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.463747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:21.464257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.466494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.481653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a78a-cb3e-4108-8c54-8614f04ae0cb None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.483140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 439/852] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:21.490304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.511094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:21.536991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.537644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.537921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.538192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.538828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.540833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:21.553205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:21.554149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:21.554980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:21.559801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 414/853] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:21.560783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.617824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdda0f-02b8-4323-b6e1-2fc298cacb73 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.655618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907b74-3296-459d-a932-e6be847beabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.656240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907b74-3296-459d-a932-e6be847beabc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.656537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907b74-3296-459d-a932-e6be847beabc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.656867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907b74-3296-459d-a932-e6be847beabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.657659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89907b74-3296-459d-a932-e6be847beabc None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=8d2a9820c2314fd8acbf6739408980af) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:21.658016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89907b74-3296-459d-a932-e6be847beabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.659559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89907b74-3296-459d-a932-e6be847beabc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.672611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 440/854] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/role_assignments?user.id=8d2a9820c2314fd8acbf6739408980af&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:21.676248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c977d-7c3e-43a9-9ee9-11fe2d34e919 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.717079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.718076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.718563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.719037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.719974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:21.720534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.722190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dde30-a1f8-4672-bbb7-0319eccb08a9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.728239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 415/855] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:21.740351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907b74-3296-459d-a932-e6be847beabc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:21.752395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:21.848684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907b74-3296-459d-a932-e6be847beabc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:21.885658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:21.886749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:21.887234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:21.888414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:21.889164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:21.889691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:21.890871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522521ed-7a38-452b-9fe0-5e33b971ecca None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:21.896737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 441/856] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:22.027530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60409-b91c-4ca1-b0c1-477ab6136ef3 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.027725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60409-b91c-4ca1-b0c1-477ab6136ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.028007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f60409-b91c-4ca1-b0c1-477ab6136ef3 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.030300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 416/857] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:22.035938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e501a8-bde4-4927-861b-7ee15b225229 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.036231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e501a8-bde4-4927-861b-7ee15b225229 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.036553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e501a8-bde4-4927-861b-7ee15b225229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.057142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c5e501a8-bde4-4927-861b-7ee15b225229 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:22.058329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c5e501a8-bde4-4927-861b-7ee15b225229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:22.144237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 442/858] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:22.167859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f60409-b91c-4ca1-b0c1-477ab6136ef3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:22.191721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab1e9-c1b7-41d6-8eb7-1ce175e3440c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.192380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab1e9-c1b7-41d6-8eb7-1ce175e3440c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.192866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ab1e9-c1b7-41d6-8eb7-1ce175e3440c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.194822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 443/859] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:22.204311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.204311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.204311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.220753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:22.222094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:22.224398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:22.233471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:22.294306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f60409-b91c-4ca1-b0c1-477ab6136ef3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:22.308375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 444/860] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:22.332568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:22.339719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:22.340397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.340681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.341025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.352803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:22.358043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:22.359042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:22.359884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 417/861] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:40:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:22.367325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:22.444140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9a96-18b1-435d-bb87-fa7806d8acaa None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:22.483727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:22.484601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.485025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.485358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.486076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:22.487913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:22.500216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:22.507189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a5683-5f2e-4003-9e33-4f932bae5da6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:22.508328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 445/862] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:22 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:40:22.521464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:22.564639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:22.565501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.565973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.566387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.567262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:22.567711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:22.569282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:22.580308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 418/863] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:40:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:22.589463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:22.709255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad5a61-c845-4ffa-853d-ad7f6c2cc215 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:22.747129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:22.747791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.748070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.748377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.760390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:22.761862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:22.777648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:22.779295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:22.780448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:22.780448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:22.780448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:22.780448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:22.780448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 446/864] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:22.785650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:22.898034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fd5c1-1548-47ad-98ab-d584fb40aa90 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:22.938238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:22.939180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:22.939635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:22.940079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:22.941000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:22.941494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:22.943040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:22.957332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 419/865] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:22.963311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:23.022224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:23.082208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ce482-e1d7-4e2e-8dfc-6f9b6950d413 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:23.119049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:23.119696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.119982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.120255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.128951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:23.130411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:23.144890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:23.146096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:23.147253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:23.149781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 447/866] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:23.155616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:23.185500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:23.273076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98379b-6749-49d0-b780-708bf6146190 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:23.309129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:23.310378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.310656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.311027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.311721 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:23.312021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:23.313560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:23.332933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 420/867] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:23.339146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:23.453541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca72def-9dba-45e9-b2ae-d5c3fad1940e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:23.464105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:23.492658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:23.493663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.494151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.494627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.570717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:23.572173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:23.676133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 448/868] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:23 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:23.681802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:23.768143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:23.796160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8867d91-3220-4b8c-a148-60f4772f9e88 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:23.831165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:23.831806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.832081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.832373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.843940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:23.845492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-28ccd5b7-ba42-4372-be61-6855fc864f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:23.861377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:23.862328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:23.863223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:23.863223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:23.863223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:23.863223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:23.863223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 421/869] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:23.869639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:23.881855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:23.910249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228442f3-e55f-4a74-b48b-2cd0d7e80451 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.911431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228442f3-e55f-4a74-b48b-2cd0d7e80451 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.911949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228442f3-e55f-4a74-b48b-2cd0d7e80451 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.913821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 422/870] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:23.918741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:23.919578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:23.919860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:23.939082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:23.940452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:23.997683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e6aaa-afb0-44e8-a283-76745ac330c4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.020755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 423/871] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:24.033488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.034116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.034400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.034679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.035440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:24.035749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.037210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.040866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.049471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 449/872] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:24.054914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.121269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.139036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.170677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40614-171e-43fd-b684-b40e0aa19c52 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.175416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d0714-59ed-473b-b015-bf7f9b3c4a5b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.206822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.207736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.208111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.208359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.214292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.215164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.215547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.215876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.216859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.217602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.217871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.219438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:24.228867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:24.229872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:24.230694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-01cc4b3f-e569-4b58-8bd4-5a244962ee71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:24.231938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:24.232761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 450/873] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c09e-8504-4fcf-bbb9-b29e87d73d5d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.233635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c09e-8504-4fcf-bbb9-b29e87d73d5d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.234232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5c09e-8504-4fcf-bbb9-b29e87d73d5d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.236343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 424/874] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:24.237434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 451/875] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:24.237836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.238605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.238892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.239171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.257004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:24.258194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:24.332404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 452/876] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:24.332404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.362006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aba366-7a71-42b7-a4d5-db97d4fc518c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.391086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.394776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.405676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.406303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.406585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.406858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.407690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:24.408001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.409532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.428369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 425/877] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:24.428369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.440346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300d5fc-04d8-4d0c-9387-e476de3bf6b8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.480608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.481273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.481594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.482385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.483124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:24.483376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.484778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.489614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 453/878] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:24.490409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.534373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cc39d-e63c-4304-86c6-e36c0bba435a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.569986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.570611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.570896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.571171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.571861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.573269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.589973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 426/879] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:24 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:24.591228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:24.615080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99491c11-8b5a-401c-91c6-ef9712fd85f1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.655187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.662640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:24.683846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.684945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.685715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.686213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.687908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=d0fd5b7fad8e4578850502f9cacad2a3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:24.688789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.691744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7327-d631-461b-b849-864dc70c28e4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.704891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 454/880] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/role_assignments?user.id=d0fd5b7fad8e4578850502f9cacad2a3&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:24.734668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e1ac-22a6-483f-a7b2-eade1e2bfbbd None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.734989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e1ac-22a6-483f-a7b2-eade1e2bfbbd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.735219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67e1ac-22a6-483f-a7b2-eade1e2bfbbd None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.737112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 455/881] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:24.737757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ea34-cbbc-4792-8032-134868b92152 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:24.745586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.745955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.746145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.770559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:24.772198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:24.788889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:24.789364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:24.789752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:24.790034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:24.790740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:24.791053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:24.792504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:24.799910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 427/882] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:24.867306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 456/883] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:24.890675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:25.009852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ffebe1-b66f-4bf0-8d63-21ad72daf1c3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:25.024442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:25.048996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:25.049706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:25.050086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:25.050370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:25.051005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:25.052414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:25.065689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:25.066664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:25.067477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 428/884] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:25.074786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:25.189132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcfef1-f1f2-4a34-8e05-c417141ac273 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:25.204656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:25.227040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:25.227723 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:25.228007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:25.228305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:25.228993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:25.229299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:25.230660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:25.235977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 457/885] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:25.241710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:25.354199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91d1f3-4ed5-4612-9ccc-6eb23ed3da0a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:25.396195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:25.396770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:25.397050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:25.397323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:25.398006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:25.398312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:25.399680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:25.405097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 429/886] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:25.410728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:25.521475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c8b45-8413-4b7c-b66e-afd3af799eaa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:25.558176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:25.558808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:25.559092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:25.559372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:25.560744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] RBAC: Adding query filter params (interface=public, service_id=0465e4003af743729eb9592f10ac190c, region_id=RegionOne) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:25.561058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:25.562419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370921c-f0b5-435e-aef9-2c24a8d0767a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:25.568303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 458/887] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:25 2022] GET /identity/v3/endpoints?service_id=0465e4003af743729eb9592f10ac190c&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:25.573686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:25.624625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:25.685568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d98a1-c3dd-4b6b-ab06-8d8ca40d3210 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:25.721310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:25.721934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:25.722218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:25.722500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:25.723162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:25.724567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9acaf-3627-4eb4-a24e-827309054b7d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:25.730809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 430/888] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:25 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:40:26.714694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b25f-146b-40dc-bf19-a4843153a4e5 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:26.715213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b25f-146b-40dc-bf19-a4843153a4e5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:26.715213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b25f-146b-40dc-bf19-a4843153a4e5 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:26.717355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 459/889] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:26.722741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10978b0-4a7b-45f4-a0d2-7becfe93dfa5 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:26.723558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10978b0-4a7b-45f4-a0d2-7becfe93dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:26.724032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10978b0-4a7b-45f4-a0d2-7becfe93dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:26.742937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c10978b0-4a7b-45f4-a0d2-7becfe93dfa5 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:26.744447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c10978b0-4a7b-45f4-a0d2-7becfe93dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:26.820403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 431/890] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:26.844864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09b25f-146b-40dc-bf19-a4843153a4e5 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:26.895169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:26.908206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9477ee-6e64-4360-94ff-3d3d093dd5a5 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:26.908534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9477ee-6e64-4360-94ff-3d3d093dd5a5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:26.908808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9477ee-6e64-4360-94ff-3d3d093dd5a5 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:26.911346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 432/891] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:26.915297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a907-109b-4a78-94d1-5d5630658f87 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:26.915645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a907-109b-4a78-94d1-5d5630658f87 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:26.915927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65a907-109b-4a78-94d1-5d5630658f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:26.934999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-cb65a907-109b-4a78-94d1-5d5630658f87 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:26.936018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-cb65a907-109b-4a78-94d1-5d5630658f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:26.958840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09b25f-146b-40dc-bf19-a4843153a4e5 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:26.964973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:26.997219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:26.997893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:26.998562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:26.998852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:26.999481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.000874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-0da63987-cbd1-4965-8cd0-51b65f18216b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:27.009659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:27.010779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:27.011650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 460/892] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Jul 25 22:40:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:27.013076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ffe4-a73a-4d7f-a4be-48672f6fe722 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.013150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ffe4-a73a-4d7f-a4be-48672f6fe722 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.013375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ffe4-a73a-4d7f-a4be-48672f6fe722 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.018458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 461/893] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:27.018458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ffe4-a73a-4d7f-a4be-48672f6fe722 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.019674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 433/894] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:27.020940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.021222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.021493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.045796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:27.046988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:27.118399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 434/895] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:27.129171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.129777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ffe4-a73a-4d7f-a4be-48672f6fe722 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.143364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.172805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.173743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.174210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.174657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.175530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:27.176056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.177640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.183014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 462/896] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:27.183999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.237284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.244810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80137d94-c543-4c49-8244-842bf79b55cd None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.281572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.282199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.282480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.282753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.283445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.284841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.297018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495ab49-9f5f-44f6-aae3-4a444cf4c631 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.309167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 435/897] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:27 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:27.309167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.348129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.348866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.349187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.349465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.364220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:27.369617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:27.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:27.371691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:27.376830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 463/898] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:27.378150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.418003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.448231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf859d-6f7a-40dc-90d1-e1353c15891b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.492269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.493166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.493609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.493886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.494575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:27.494916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.496262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.501837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 436/899] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:27.507344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.519075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a4f82-d18b-4efb-9b01-283d7919f25a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.533478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.561286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.562315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.562816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.563286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.564208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:27.564756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.566305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.575557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 464/900] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:27.581700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.640901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd4c77-c6ca-49ba-aa17-8b26a75418da None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.676964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.681593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.682268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.682556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.682835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.683600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] RBAC: Adding query filter params (interface=public, service_id=add6d06dd3c14e7daf9f6dbd60b6010a, region_id=RegionOne) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:27.683918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.686179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.690109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ec89d-276f-49e4-b6f5-da5fd8a7b5d4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.699084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 437/901] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/endpoints?service_id=add6d06dd3c14e7daf9f6dbd60b6010a&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:27.700226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.726925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.727608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.727849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.728127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.740299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.741812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-5fd1dfe8-b690-4585-b5a0-48e25de80113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:27.756903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:27.757833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:27.758732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:27.758732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:27.758732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:27.758732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:27.758732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 465/902] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:27.759844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86a9-229b-484c-b05d-31441f489f21 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.760134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86a9-229b-484c-b05d-31441f489f21 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.760443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a86a9-229b-484c-b05d-31441f489f21 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.762128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 466/903] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:27.765584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a86a9-229b-484c-b05d-31441f489f21 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.788842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.807422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7bbf-fbb7-4818-af2a-55d190ff8bc7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.843308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.843937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.844309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.844518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.845309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.846646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f38d5d7-e159-449a-93d4-0ea289963001 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.852858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 438/904] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:40:27.852858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.852858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.852858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.875206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:27.876509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:27.920744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a86a9-229b-484c-b05d-31441f489f21 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:27.955755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 439/905] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:27.972117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:27.972791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:27.973068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:27.973340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:27.974047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:27.974403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:27.975784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:27.981351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:27.990975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 467/906] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:27.991535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:27.997771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.073932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.106457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b005d26-bf8f-4d91-a534-b6222972129b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.122989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a9a04-d39d-48d9-a7d9-409b42032945 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.152100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.152916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.153808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.154768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.155633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.157011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:28.166845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:28.167866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:28.168772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 440/907] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:28.172196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.173044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.173468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.173926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.174177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.184005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.186757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:28.207075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:28.208274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:28.209277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:28.210152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 468/908] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:28.217938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.290219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.325573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9612f-e1f8-445c-a064-a73ef38a0c1d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.333882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02086-b757-4df9-a04d-f5b389ee1393 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.369331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.369980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.370273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.370511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.371312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:28.371614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.373797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.378267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.379206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.379698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.380205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.381123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:28.381962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.384646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.393692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 441/909] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:28.400381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 469/910] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:28.400527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.400609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.403088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.505737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0891500-63ce-4131-a4af-b1d0245ef02b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.506746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300d23-1b67-4927-9cc0-567eb56b77d4 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.526799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.545115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.545833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.546184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.546493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.546647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.547334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:28.547547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.547779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.548112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.548571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.549475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.559868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 442/911] 10.222.0.59 () {56 vars in 1114 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:28.560936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.628687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.630178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.634121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.679003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9aafb-fba5-4521-b883-1e7848ac2d10 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.716981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.717885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.718541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.719094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.719987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.721742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.742794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 470/912] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:40:28.744114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:28.752661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 443/913] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:28.765223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:28.856771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc205ac-5316-442b-a5d0-640a542b92bf None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:28.901129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:28.901751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:28.902037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:28.902320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:28.914161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:28.915621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:28.931692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:28.932738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:28.933642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:28.933642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:28.933642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:28.933642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:28.936049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 471/914] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:28.939295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.051155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed524-edfb-4fc8-8ad6-f3577d735315 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.079290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:29.091140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.091905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.092309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.092727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.093533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:29.094172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.095778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.109176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 444/915] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:29.115246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.190419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:29.227609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b573f-dfef-4c91-8ced-a8eb4cd4a192 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.263197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.263847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.264130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.264434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.271491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.272969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-4d7ca0d7-840b-4835-aaf0-a7ba0dbc0af1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:29.284826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:29.285762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:29.286658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:29.290752 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 472/916] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:29.292091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.398204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5673d-28d1-4a54-9ba3-8af85c8d73af None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.417407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a6b6c-c56b-4a6c-97f1-48caeab5598c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.417781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a6b6c-c56b-4a6c-97f1-48caeab5598c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.418135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a6b6c-c56b-4a6c-97f1-48caeab5598c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.420480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 473/917] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:29.425352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.425714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.426520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.437403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.438022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.438297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.438564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.439312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:29.439613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.441112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.449622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:29.451722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:29.453462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 445/918] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:29.461275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.520082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:29.537693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 474/919] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:29.560440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.586143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a72e7-5353-45cd-9c05-dc5a6b64ad6f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.623415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.623627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:29.624865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.625436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.625912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.627049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] RBAC: Adding query filter params (role.id=62108e73e2f047ca99670e1200bda1d5, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=d0fd5b7fad8e4578850502f9cacad2a3) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:29.627560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.629210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.635813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 446/920] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/role_assignments?user.id=d0fd5b7fad8e4578850502f9cacad2a3&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=62108e73e2f047ca99670e1200bda1d5 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:29.682313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7a34-df3d-4b67-ad68-41bb085f4c1b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.722260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.723362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.723855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.724410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.725256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.726879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:29.737840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:29.738929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:29.739783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:29.742952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 475/921] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:29.749295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:29.860672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dde52-5df2-4742-babc-3de7f77b66ca None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:29.870572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:29.896557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b468f-1248-4468-ac63-3125a797683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:29.897187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b468f-1248-4468-ac63-3125a797683a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:29.897469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b468f-1248-4468-ac63-3125a797683a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:29.897743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b468f-1248-4468-ac63-3125a797683a None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:29.898428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b468f-1248-4468-ac63-3125a797683a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:29.898735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b468f-1248-4468-ac63-3125a797683a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:29.900110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b468f-1248-4468-ac63-3125a797683a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:29.905864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 447/922] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:29.911295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.022903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525b80a-cad8-457f-902f-b94f1171e558 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.037490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dd08-86b1-4e4d-bd61-f8e45d606dd6 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.038010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dd08-86b1-4e4d-bd61-f8e45d606dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.038089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2dd08-86b1-4e4d-bd61-f8e45d606dd6 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.039636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 448/923] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:30.045149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:30.046239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.046735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.047499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.061460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.062091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.062370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.062644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.063332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:30.063647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.065648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.071172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:30.071437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 476/924] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:30.072920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:30.081225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.164384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 449/925] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:30.185934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.197364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c9e6-e01e-42ef-9a7f-8bea034ed2eb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.239837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.240756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.241209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.241634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.242535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] RBAC: Adding query filter params (interface=public, service_id=e654220fd1c7418f9c8a15a14505389e, region_id=RegionOne) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:30.242996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.244546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.250819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 477/926] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:30 2022] GET /identity/v3/endpoints?service_id=e654220fd1c7418f9c8a15a14505389e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:30.255934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.302498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcd28b-0ec7-49cc-8399-500fa027cefd None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.304106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:30.321868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:30.359699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.360950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.361388 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.362056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.363257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.364835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.378105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e49d4-8973-49fb-93b5-5bd3f021a63d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:30.378432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:30.379583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 22:40:30.380656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:30.384373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 450/927] 10.222.0.59 () {56 vars in 1132 bytes} [Mon Jul 25 22:40:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:30.394506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.419816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.420683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.420988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.421357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.422173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.423670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.436450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 478/928] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:30 2022] GET /identity/v3/services => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:40:30.509555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ded35f-2052-4e47-930e-2776463cb0cc None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.548174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.549088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.549544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.549975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.550841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:30.551302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.553045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.564161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 451/929] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:30.565868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.674169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad65251-2602-410a-a9a9-f324ab14f750 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.687965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:30.710707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.711566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.712033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.712747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.713568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:30.714018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.715572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e8470-2596-4b5e-ac27-d617a6bd2b1e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.724405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 479/930] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:30.727036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:30.760131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:30.836392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c7a29-71a8-4384-b6c5-f8aa278fb72a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:30.872757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:30.873657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.874083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.874519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.875369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:30.876906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:30.890784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263a2a-60d6-4f22-abdb-76dbfabc2a58 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.891293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263a2a-60d6-4f22-abdb-76dbfabc2a58 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.891395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0263a2a-60d6-4f22-abdb-76dbfabc2a58 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.892974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 480/931] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:30.898116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:30.898346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:30.898591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:30.914364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 452/932] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:30.920367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:30.920367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:31.007690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 481/933] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:31.031469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:31.127046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:31.150716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb654cf-769b-40e4-8bab-0433626929e5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:31.186521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:31.187576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:31.188053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:31.188562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:31.189513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:31.191144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:31.194008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING keystone.server.flask.common [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 22:40:31.214429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.sql.core [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:40:31.214429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:40:31.214429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [parameters: {'id': '10e27c3696c24a51808d1d50040935a0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:40:31.214429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87031) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10e27c3696c24a51808d1d50040935a0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10e27c3696c24a51808d1d50040935a0. Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:40:31.231844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result.read() Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 22:40:31.232739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application yield resource Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise self.value Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application session.commit() Jul 25 22:40:31.233698 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:40:31.234582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:40:31.235503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result.read() Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:40:31.236405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [parameters: {'id': '10e27c3696c24a51808d1d50040935a0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:31.237279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:31.238046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10e27c3696c24a51808d1d50040935a0. Jul 25 22:40:31.238940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:31.242569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 453/934] 10.222.0.59 () {60 vars in 1140 bytes} [Mon Jul 25 22:40:31 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:31.249285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:31.357943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e03f974-f72a-46e2-b392-7936b272b6fd None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:31.359459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:31.394561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:31.395135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:31.395420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:31.395695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:31.402589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:31.404123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-7b0adabd-aab3-46b9-a6bd-1c30a629e237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:31.415675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:31.417734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:31.421987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 482/935] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:31.425678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:31.535217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56528e3-2316-4665-978e-fafc34dc3242 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:31.572021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:31.572997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:31.573496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:31.573990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:31.575048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:31.575587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:31.577609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c743e2-5dea-4b47-8062-ea5bc65fd0ac None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:31.599865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 454/936] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:31.733991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15a71-4592-4a32-9ece-68b082084952 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:31.734338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15a71-4592-4a32-9ece-68b082084952 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:31.734453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15a71-4592-4a32-9ece-68b082084952 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:31.736125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 483/937] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:31.741794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:31.742102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:31.742359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:31.749933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:31.764984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:31.766521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:31.841193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 455/938] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:31.865022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15a71-4592-4a32-9ece-68b082084952 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:31.969814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15a71-4592-4a32-9ece-68b082084952 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.006618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.007615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.008099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.008614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.019403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:32.024622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:32.025566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:32.026405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:32.029644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 484/939] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:32.036320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.144630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b5f017-779d-4828-8516-26e3f013ff55 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.178360 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.184841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.185912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.186466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.187045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.192305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:32.192305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.192305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.201091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 456/940] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:32.206745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.240724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.320257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc58bd-e839-433b-be2d-781de66285dc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.354808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.355460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.355740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.356573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.366751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.368312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-1acb1761-0466-433e-87aa-222b75f7f1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:32.383664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:32.384576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:32.385492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:32.385492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:32.385492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:32.385492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:32.385492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 485/941] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:32.393539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.504330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b258190-8252-4739-8104-3e30e373f0e5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.541057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50d94-e070-4108-97e1-88bee204ddf8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.541245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50d94-e070-4108-97e1-88bee204ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.541480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50d94-e070-4108-97e1-88bee204ddf8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.541887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.542518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.542800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.543075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.544375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:32.544687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.546250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.547168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 486/942] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:32.548316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.548601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.548874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.560055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 457/943] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:32.565481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.567779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:32.568987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:32.625836 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.641734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 487/944] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:32.663967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.669212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.681110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7762ed79-caa2-4786-a52c-2decb7bea67f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.721589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.722543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.723044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.723551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.731738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.733623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:32.747944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:32.749202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:32.750139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:32.752989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 458/945] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:32.758593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.783599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d5f82-344c-45e1-98c1-ea7e44c3ed31 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.831136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.832045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.832350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.832625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.833256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.835371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:32.847612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:32.849737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:32.850584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:32.854289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 488/946] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:32.855166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.881730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ec59d-4eb1-46a9-acb0-736dd38e2d79 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:32.903213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.931135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:32.931770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:32.932048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:32.932777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:32.933628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:32.933937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:32.936352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:32.941287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:32.966316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 459/947] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:32.971552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:32.987295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133569e-ff3c-482a-bc4d-5fdd76fb9b0e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.031629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.032923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.033648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.034103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.035112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:33.035894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.037751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.049462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 489/948] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:33.050597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.086460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537057-5f3f-4b1e-b885-d30ade355012 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.127639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.127639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.127639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.127639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.140784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.142198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-92ed7d10-7081-4490-92dc-738c44cf0d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:33.157253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:33.158691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:33.159773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:33.159773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:33.159773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:33.159773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:33.163218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 460/949] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:33.164481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65904f-db61-4a21-9632-98ac3757272a None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.164770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65904f-db61-4a21-9632-98ac3757272a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.165048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65904f-db61-4a21-9632-98ac3757272a None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.166318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 461/950] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:33.167014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65904f-db61-4a21-9632-98ac3757272a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.183699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6de08-f90d-4391-8db0-872ccfcfbeac None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.194905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.215141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.221058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.221672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.222252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.222563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.223209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:33.223768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.224992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52c94-1a74-45e1-9ed3-1bc4ed93a15b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.235145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 490/951] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:33.235145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de830f-63da-4467-bef0-b3293c114837 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.235145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de830f-63da-4467-bef0-b3293c114837 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.235145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de830f-63da-4467-bef0-b3293c114837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.252250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-65de830f-63da-4467-bef0-b3293c114837 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:33.253493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-65de830f-63da-4467-bef0-b3293c114837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:33.283273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65904f-db61-4a21-9632-98ac3757272a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.320718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.321344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.321627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.321902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.322602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:33.322907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.324273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.328464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 491/952] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:33.328464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de830f-63da-4467-bef0-b3293c114837 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.344620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 462/953] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:33.345676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.435132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.438279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de830f-63da-4467-bef0-b3293c114837 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.453573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf9fd0-25aa-4bf9-bbed-d228410ad019 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.467715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.478172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.478756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.479039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.479423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.480243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.482509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.491307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.492034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.492345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.492626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.500262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.501720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.504483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 492/954] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:33.505405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:33.522821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:33.523993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:33.524979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:33.531679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 463/955] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:33.532213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.650131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d9c2d-c5e9-4523-91a5-474f845d37a1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.687720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168ed-bc33-458d-a222-523f81b0473b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.697195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.699907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.700235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.700550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.701191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.702569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:33.713120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:33.714232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:33.715131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 493/956] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:33.723702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.742780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.743626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.744098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.744580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.745590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:33.745994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.753740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.769727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 464/957] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:33.776874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.782886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.796461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:33.862243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04452e-ca8f-47f8-9f15-c5f330b42bf7 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.885369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5931c-3ae8-46bc-ad6f-33a91256cd5c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:33.899068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.899826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.900335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.900720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.901506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:33.901915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.903992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f29d0-426e-44f9-a3f4-e0b7806c5e0f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.909013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 494/958] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:33.915100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c5e69-3d51-4f8b-add9-8b49876e19e8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.915395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c5e69-3d51-4f8b-add9-8b49876e19e8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.915677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c5e69-3d51-4f8b-add9-8b49876e19e8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.920476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 495/959] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:33.920476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c5e69-3d51-4f8b-add9-8b49876e19e8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:33.926827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:33.927610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.928410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.928784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/d0fd5b7fad8e4578850502f9cacad2a3/roles/62108e73e2f047ca99670e1200bda1d5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.931765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=d0fd5b7fad8e4578850502f9cacad2a3, role_id=62108e73e2f047ca99670e1200bda1d5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:33.933338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81004c28-12f9-428d-8e59-f021b88458b0 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:33.948357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 465/960] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:33 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/d0fd5b7fad8e4578850502f9cacad2a3/roles/62108e73e2f047ca99670e1200bda1d5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:40:33.950343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:33.950618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:33.950890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:33.978323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:33.979974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:34.046078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c5e69-3d51-4f8b-add9-8b49876e19e8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:34.054410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:34.071150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:34.071639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 466/961] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:34.088242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:34.088910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:34.089195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:34.089869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:34.090219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:34.091224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:34.092814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:34.098633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 496/962] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:34.099674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:34.221815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a303fde-b823-4191-9e1a-f9ffc82d37d3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:34.260613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:34.261257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:34.261541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:34.261819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:34.263090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:34.265617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:34.279727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.sql.core [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:40:34.279727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:40:34.279727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [parameters: {'user_id': 'a467c00af1fd4de0ab745f8ff8d1493c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:40:34.279727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87031) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result.read() Jul 25 22:40:34.286899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:40:34.287791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application yield resource Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application next(self.gen) Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise self.value Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application session.commit() Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 22:40:34.288884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.session.flush() Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application compat.raise_( Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 22:40:34.289797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 22:40:34.290692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application conn.query(q) Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application result.read() Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 22:40:34.291536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a467c00af1fd4de0ab745f8ff8d1493c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:34.293447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 22:40:34.295303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:34.297412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 467/963] 10.222.0.59 () {60 vars in 1131 bytes} [Mon Jul 25 22:40:34 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:34.304087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:34.414325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d8ee9-8a00-434f-a55f-18bc2740b279 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:34.449370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:34.450592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:34.450872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:34.451150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:34.458651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:34.460093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c049273f-d20b-4422-8fbd-0bf127232af0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:34.473229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:34.474207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:34.475159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 497/964] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:34.482623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:34.568777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:34.588468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049faf6-86b2-4447-b83c-82044e8d88e6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:34.624909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:34.625942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:34.626447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:34.626923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:34.627885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:34.628413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:34.630260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf242ffe-f072-4ea8-863a-78b31673037a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:34.669653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 468/965] 10.222.0.59 () {56 vars in 1101 bytes} [Mon Jul 25 22:40:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:35.632875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fad7-9a79-49d6-99ba-6c449e26aadc None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:35.632875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fad7-9a79-49d6-99ba-6c449e26aadc None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:35.633743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9fad7-9a79-49d6-99ba-6c449e26aadc None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:35.635088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 498/966] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:35.641148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:35.641591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:35.641772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:35.668217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:35.669833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:35.739829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 469/967] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:35.762817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fad7-9a79-49d6-99ba-6c449e26aadc None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:35.794183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:35.868242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9fad7-9a79-49d6-99ba-6c449e26aadc None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:35.903504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:35.904096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:35.904407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:35.904686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:35.905316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:35.906679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-26905c16-d38e-4835-8721-bcb307cba510 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:35.915819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:35.916882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:35.922879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 499/968] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:35.925617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:35.974056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.030288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9141e7-14fb-4998-95f7-4f302ce5fbf3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.051719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cdb7-1ed2-454e-9c0a-f77eacc455fa None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.052024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cdb7-1ed2-454e-9c0a-f77eacc455fa None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.052891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cdb7-1ed2-454e-9c0a-f77eacc455fa None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.054232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 500/969] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:36.059892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.060171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.060485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.067199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.068692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.068977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.069251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.069939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:36.070245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.071601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.078573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:36.078921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 470/970] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:36.079758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:36.084500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.153625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 501/971] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:36.175993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.197788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b7483-e3b5-4a2b-93d1-1ba66f3bccb2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.202781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.209453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.236660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.237334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.237615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.237889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.238563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:36.238907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.240275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94d699-4f5a-4c99-8797-f03b281a6e21 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.245239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 471/972] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:36.249550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93327-dacf-4a1a-98d7-b836ecc36426 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.249840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93327-dacf-4a1a-98d7-b836ecc36426 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.250116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea93327-dacf-4a1a-98d7-b836ecc36426 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.251368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 472/973] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:36.252064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93327-dacf-4a1a-98d7-b836ecc36426 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.279612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f70d3-09d7-4204-9066-8eccdb89b2ad None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.313363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.314005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.314288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.314563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.324352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-09f82309-e88c-4139-8824-907372cdd19f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:36.329275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:36.330279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:36.331162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 502/974] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:36.332184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.332184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.332184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.349298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:36.350549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:36.354052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea93327-dacf-4a1a-98d7-b836ecc36426 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.387620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.388234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.388537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.388811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.389562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] RBAC: Adding query filter params (interface=admin, service_id=e654220fd1c7418f9c8a15a14505389e, region_id=RegionOne) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:36.389871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.391220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.396059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 473/975] 10.222.0.59 () {56 vars in 1249 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/endpoints?service_id=e654220fd1c7418f9c8a15a14505389e&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:36.396850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.421145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 503/976] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:36.421901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.433426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.439764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.497628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b751388-483f-4f29-abb3-0d2e524b83ff None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.523487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82820eb-7674-4adb-99be-3fd0b84c7ffb None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.530859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.531468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.531745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.532016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.532758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:36.533059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.534538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.542313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 474/977] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:36.543063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.561418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.562034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.562310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.562578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.563219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.564605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.570361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 504/978] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:40:36.571119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.643763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.649189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c15e-c3a3-4029-b8f9-60bd1e6fea14 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.660884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:36.686692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f258e48-3fad-4e9f-b46c-79069e3175c7 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.689036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.689756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.690100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.690381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.691090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.692501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.708209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 475/979] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:36 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:36.740244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.740953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.741240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.741519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.754044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.755776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:36.773526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:36.774499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:36.775415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:36.775415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:36.775415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:36.775415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:36.775415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 505/980] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:36.782988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:36.901689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aec8b-3627-4e8d-bd1f-031c4654ddc4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:36.936859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:36.937402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:36.937684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:36.937957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:36.938651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:36.938954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:36.940343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:36.957411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 476/981] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:36.958955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:37.061684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2dd0e4-e469-4e35-8b39-fcf31ee781f9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:37.088768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:37.098954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:37.099598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:37.099878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:37.100153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:37.107934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:37.109405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:37.120785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:37.121782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:37.122753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 506/982] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:40:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:37.128332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:37.151846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:37.235876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cc2a5-7712-49fe-8f73-621efad995d2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:37.270776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:37.271394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:37.271670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:37.271940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:37.272765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:37.273067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:37.274477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:37.291650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 477/983] 10.222.0.59 () {56 vars in 1149 bytes} [Mon Jul 25 22:40:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:37.297337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:37.397621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2ace2-49ed-452a-9431-849c0bbe3133 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:37.430076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:37.430692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:37.430970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:37.431242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:37.485454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:37.499866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:37.501273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:37.597232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 507/984] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:37 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:37.602758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:37.686858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:37.710877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a208fa-12d4-41a7-b05b-427384339945 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:37.747649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:37.748326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:37.748589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:37.748858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:37.758926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:37.760313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:37.775175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:37.776095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:37.777027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:37.777027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:37.777027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:37.777027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:37.780617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 478/985] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:37.782160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:37.867539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:37.883669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3311b-d43e-4382-95d1-3b1a7e1ea921 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:37.917769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:37.918952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:37.919337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:37.919612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:37.920310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:37.920612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:37.921964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:37.933192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 508/986] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:37.938776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.038015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbab6cc-84d9-4f92-9937-0ae5e268c1ee None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:38.064757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:38.073590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:38.074226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.074527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.074800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.081565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:38.083028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:38.094873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:38.095779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:38.097043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:38.100601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 479/987] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:38.101868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.210371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94695595-80f1-4799-9dd0-695299bc283f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:38.244525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:38.245235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.245516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.245787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.246561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:38.246861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:38.248271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b7ba1-40f7-4212-8705-788e27c00058 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:38.260394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 509/988] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:38.268958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.371885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c69444-ccac-43a6-b82e-539db991f6f3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:38.405948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:38.406557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.406832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.407101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.407908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] RBAC: Adding query filter params (role.id=62108e73e2f047ca99670e1200bda1d5, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=d0fd5b7fad8e4578850502f9cacad2a3) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:38.408219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:38.409667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110450d-7359-4b00-aa83-355d4d44ec74 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:38.415538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 480/989] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:38 2022] GET /identity/v3/role_assignments?user.id=d0fd5b7fad8e4578850502f9cacad2a3&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=62108e73e2f047ca99670e1200bda1d5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:38.614216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660752-1441-4b67-8bf8-167ad9233474 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.614506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660752-1441-4b67-8bf8-167ad9233474 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.614785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb660752-1441-4b67-8bf8-167ad9233474 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.616156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 510/990] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:38.621714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158e78-08aa-48d3-a002-b1b80f3c5cbf None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.622131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158e78-08aa-48d3-a002-b1b80f3c5cbf None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.622408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158e78-08aa-48d3-a002-b1b80f3c5cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.641115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-99158e78-08aa-48d3-a002-b1b80f3c5cbf None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:38.642395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-99158e78-08aa-48d3-a002-b1b80f3c5cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:38.693472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:38.716324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 481/991] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:38.738188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660752-1441-4b67-8bf8-167ad9233474 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.747756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:38.759461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4a81-3ac1-4252-b895-877af8715632 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.759743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4a81-3ac1-4252-b895-877af8715632 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.760017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4a81-3ac1-4252-b895-877af8715632 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.761671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 482/992] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:38.767300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.767586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.767864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.785569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:38.786732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:38.856932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb660752-1441-4b67-8bf8-167ad9233474 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:38.860524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 483/993] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:38.882997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.894343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:38.895006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:38.895581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:38.896001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:38.896800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:38.898657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:38.909803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:38.910824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 22:40:38.911705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:38.912489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 511/994] 10.222.0.59 () {56 vars in 1126 bytes} [Mon Jul 25 22:40:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:38.917301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:38.992743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c1e56d-5282-4e3f-970b-06276cada90c None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:38.994042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.010834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.029909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2114f-0b9c-4960-bfcf-fdae9cf7c0a3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.035271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.035921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.036199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.036499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.037134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.038497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:39.048020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:39.049325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:39.050178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 484/995] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:39.054886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.069212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.069832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.070114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.070383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.071064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:39.071373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.072767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.077768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 512/996] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:39.083090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.166506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19a80-20ff-4b71-a1ed-adaf05324ad9 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.199546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a36cb3-7d04-41b8-8de4-fa12f823d6aa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.203065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.203688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.203966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.204236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.204950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] RBAC: Adding query filter params (name=compute) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:39.205256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.206623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.211628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 485/997] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:39.217834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.233822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.234436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.234722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.234995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.235660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:39.235959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.237353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.238561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.248219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 513/998] 10.222.0.59 () {56 vars in 1122 bytes} [Mon Jul 25 22:40:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:39.248881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.263198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.323267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e32637-744c-456a-8081-71dc1f4df0aa None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.358827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.359410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791df255-fc4c-437e-82e0-4637f3c9a676 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.359548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.359738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.359990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.360697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:39.361003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.362374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.367410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 486/999] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:39.373680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.395357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.395977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.396261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.396565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.397269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.398628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.416408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 514/1000] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:39.483065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f8b8f-c14a-4103-8ec0-3bb985e69226 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.485662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.526907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.528078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.528390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.528659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.529431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] RBAC: Adding query filter params (interface=public, service_id=4ea488cb9d1d4e5586e87f44aff12202, region_id=RegionOne) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:39.529741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.531127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb18b01-cea9-4012-af1f-bb0f53327386 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.537189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 487/1001] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:39 2022] GET /identity/v3/endpoints?service_id=4ea488cb9d1d4e5586e87f44aff12202&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:39.542810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:39.609416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:39.653939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ac5f7-88bd-436f-b671-f1ace0bdbfe6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:39.695966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:39.696628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:39.696910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:39.697183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:39.697838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:39.699191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6251b-ff63-4dfa-a930-53bfdc463448 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:39.706130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 515/1002] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:39 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:40:40.503476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9eeb5-0625-47e6-8175-4bce5f28aca7 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:40.503982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9eeb5-0625-47e6-8175-4bce5f28aca7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:40.503982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9eeb5-0625-47e6-8175-4bce5f28aca7 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:40.505510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 488/1003] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:40.510416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:40.510796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:40.510971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:40.529525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:40.530713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:40.599601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 516/1004] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:40 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:40.621987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9eeb5-0625-47e6-8175-4bce5f28aca7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:40.723181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9eeb5-0625-47e6-8175-4bce5f28aca7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:40.756493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:40.757069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:40.757350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:40.757626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:40.758250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:40.759609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:40.768437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:40.769419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:40.770247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:40.772626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 489/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Jul 25 22:40:40 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:40.775532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:40.834271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:40.886051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bdb27-d5df-47c2-8056-1ea677172b2f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:40.920193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:40.920855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:40.921134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:40.921404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:40.922073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] RBAC: Adding query filter params (name=image) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:40.922373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:40.923713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883a879-5146-4de1-bcf3-c2f4c792e728 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:40.933033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 517/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:40.934526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:40.964213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:41.038914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f1f35-a6d5-4fb7-bff3-57e5438f66b1 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:41.072892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:41.073508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.073791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.074064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.074765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] RBAC: Adding query filter params (type=image) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:41.075071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:41.076462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d019a-6010-4be9-9318-0cca8ffcbd77 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:41.081085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 490/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:41.452848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6214c6-c2fa-45bb-b6f9-abbc158a319f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.453226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6214c6-c2fa-45bb-b6f9-abbc158a319f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.453404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6214c6-c2fa-45bb-b6f9-abbc158a319f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.454893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 518/1008] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:41.459809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.460159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.460479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.479305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:41.480545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:41.550876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 491/1009] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:41.573133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6214c6-c2fa-45bb-b6f9-abbc158a319f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:41.677864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6214c6-c2fa-45bb-b6f9-abbc158a319f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:41.695801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:41.715778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:41.716366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.716652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.716931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.718080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:41.719508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4f173-8e3c-4b0a-b5af-b4e425e81196 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:41.725758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 519/1010] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:41.726955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:41.743944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4740d-f7e1-4cd6-8bca-6b06fe89c48e None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.744588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4740d-f7e1-4cd6-8bca-6b06fe89c48e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.745037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4740d-f7e1-4cd6-8bca-6b06fe89c48e None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.748013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 520/1011] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:41.752997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:41.753679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.753895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.754463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.777348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:41.778746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:41.835288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80605ae-0f78-4797-b094-9f05f35f1f73 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:41.856867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 521/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:41.872100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:41.872782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:41.873070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:41.873341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:41.874026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:41.875450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:41.879308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:41.908322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 492/1013] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:41 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:41.997050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c44ee-7b74-4095-ad05-fdb2c2155986 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:42.013110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:42.036120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:42.037148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:42.037618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:42.038076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:42.038932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:42.040666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:42.051582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:42.052691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:42.053538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 522/1014] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:42.059713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:42.142203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:42.170011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4769-a58d-45e7-bc49-fd6cb98320bb None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:42.206683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:42.207314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:42.207597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:42.207873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:42.208600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:42.208910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:42.210273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:42.220097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 493/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:42.221473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:42.327350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f6249-6524-4afe-b8eb-3e12cc709c28 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:42.361435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:42.362055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:42.362341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:42.362617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:42.363295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:42.363603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:42.364991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72440e5-d343-44ea-8deb-548cfada40f9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:42.375166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 523/1016] 10.222.0.59 () {56 vars in 1112 bytes} [Mon Jul 25 22:40:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:42.376369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:42.477729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d936a-e16a-45ee-b2c8-067612f198a2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:42.511581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:42.512236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:42.512543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:42.512816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:42.513532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:42.514906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee678924-b887-4f0e-9f35-4617299d1080 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:42.523319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:42.542070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 494/1017] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:40:43.081546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67444b-f41a-4cce-8158-1aa6c002c142 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:43.082078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67444b-f41a-4cce-8158-1aa6c002c142 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:43.082078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67444b-f41a-4cce-8158-1aa6c002c142 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:43.083679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 524/1018] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:43.089581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc472a-6d27-4a17-918e-9a63996f5d4c None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:43.090586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc472a-6d27-4a17-918e-9a63996f5d4c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:43.090820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc472a-6d27-4a17-918e-9a63996f5d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:43.108545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-7ecc472a-6d27-4a17-918e-9a63996f5d4c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:43.109712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7ecc472a-6d27-4a17-918e-9a63996f5d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:43.189103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 495/1019] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:43.211407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67444b-f41a-4cce-8158-1aa6c002c142 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:43.257208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:43.317297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67444b-f41a-4cce-8158-1aa6c002c142 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:43.351273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:43.351823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:43.352150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:43.352472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:43.353172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:43.354523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf0de0-1c95-4a39-8560-5dba4a747719 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:43.380331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 525/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:40:43 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:40:43.997922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c1a95-d03f-4fd1-ac75-991ea877873b None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:43.998317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c1a95-d03f-4fd1-ac75-991ea877873b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:43.998494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c1a95-d03f-4fd1-ac75-991ea877873b None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.000043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 496/1021] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:44.005592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.005885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.006162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.024450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:44.025637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:44.100618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 526/1022] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:44.125910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c1a95-d03f-4fd1-ac75-991ea877873b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:44.229595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c1a95-d03f-4fd1-ac75-991ea877873b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:44.250130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:44.266443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:44.267082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.267361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.267634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.268804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:44.270241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ef281-b564-4fc0-a93a-ed922df0821d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:44.272034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 497/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:44.278315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:44.305266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:44.380473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc78866-5fb1-411b-a2b8-cdb3d8f452ff None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:44.414819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:44.415445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.415727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.416003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.416729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:44.418179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ac570-810b-4536-b793-87c0ab7d0dad None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:44.447607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 527/1024] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:40:44 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:44.618100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cab5-763a-4332-a79d-80fcbeb7ad8e None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.618452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cab5-763a-4332-a79d-80fcbeb7ad8e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.618656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cab5-763a-4332-a79d-80fcbeb7ad8e None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.620018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 498/1025] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:44.625648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.625938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.626218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.644899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:44.646239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:44.715808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 528/1026] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:44.738191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6cab5-763a-4332-a79d-80fcbeb7ad8e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:44.845154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6cab5-763a-4332-a79d-80fcbeb7ad8e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:44.881806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:44.882370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:44.882650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:44.882922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:44.893548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:44.898450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:44.899380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:44.901173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:44.902052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 499/1027] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:44.905823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:44.922209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.009359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249d220-1a85-46c3-a393-f4e86a88d194 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.043948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.044600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.044886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.045255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.045977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:45.046284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.047684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.060326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 529/1028] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:45.062650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.114044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.176213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da944a96-978c-439e-b973-8a2dbf809a99 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.213322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.213963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.214241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.214516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.224774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.226217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:45.241187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:45.242106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:45.248246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:45.248246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:45.248246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:45.248246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:45.248246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 500/1029] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:45.250452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.330042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.361242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687953b-7af5-4836-afd0-d8f74e419a79 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.394997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.395621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.395901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.396175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.396887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:45.397190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.398549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c769a85-c89a-4d8a-aed5-ad24c934b1a8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.410877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 530/1030] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:45.416430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.430538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfc02-7701-4d0e-b8c5-7f602713a561 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.430805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfc02-7701-4d0e-b8c5-7f602713a561 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.431038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dfc02-7701-4d0e-b8c5-7f602713a561 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.435989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 531/1031] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:45.437240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.437565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.437850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.456896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:45.458094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:45.521194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.525691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938b12a-970e-4475-82ed-04cdf43c3ea8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.530729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 532/1032] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:45.554050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.562482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.563516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.564009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.564516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.573320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.574795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:45.588830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:45.590612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:45.591873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:45.593960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 501/1033] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:45.600158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.634261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.671921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab059a-0a08-4481-aee9-5aaf2952ed2d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.708722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.709183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a099898-f76a-40b9-b180-8fdcd06aa846 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.709295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.709553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.709823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] PATH_INFO: `/v3/services/image` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.710448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.711813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:45.721846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:45.722877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:45.723731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 533/1034] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:45.728970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.751914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.752573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.753129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.753414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.754368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:45.754681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.756717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.778232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 502/1035] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:45.783614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.801900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.841117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab47e4-3e2d-4e95-b7af-2aa96238b9bc None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.872316 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:45.878664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.879286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.879564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.879837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.880535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] RBAC: Adding query filter params (name=image) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:45.880838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:45.882190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:45.887609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 534/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:45.893860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:45.895828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9788c04-0270-458d-a1b1-c3d53c279662 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:45.932940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270169b-4388-4968-addb-193fd575f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:45.933589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270169b-4388-4968-addb-193fd575f92b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:45.933868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270169b-4388-4968-addb-193fd575f92b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:45.934211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270169b-4388-4968-addb-193fd575f92b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:45.998149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42565e-873b-4f03-bd93-45e80fc1cd8f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.005057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270169b-4388-4968-addb-193fd575f92b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.006475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270169b-4388-4968-addb-193fd575f92b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.025710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.032965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.033590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.033876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.034151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.034829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] RBAC: Adding query filter params (type=image) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:46.035136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.036516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.042074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 535/1037] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:46.047718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.107573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.120447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 503/1038] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:45 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:46.128655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270169b-4388-4968-addb-193fd575f92b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.162319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d09d1-326e-43b9-bd9a-3ab5b765ac95 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.197368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.197991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.198271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.198544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.199899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] RBAC: Adding query filter params (interface=public, service_id=02c0e2ad83364a509cf542eecf4eefe0, region_id=RegionOne) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:46.200209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.201594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.207069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 536/1039] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/endpoints?service_id=02c0e2ad83364a509cf542eecf4eefe0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:46.212531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.235530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270169b-4388-4968-addb-193fd575f92b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.256512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.274886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.275532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.275811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.276080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.286202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.287656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:46.302643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:46.303561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:46.304478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:46.304478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:46.304478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:46.304478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:46.304478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 504/1040] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:46.310007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.321678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec27b7-9726-4b7b-a3db-04ee44307576 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.346992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.359212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.359840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.360123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.360429 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.361082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.362556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff2ee2-95fd-46ec-827c-8fa5e797031c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.380383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 537/1041] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:40:46.430157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd2fbc-c543-4902-abf2-9b42f6a3300c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.468635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.469272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.469555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.469831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.470536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:46.470846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.472244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.489799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 505/1042] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:46.490037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b842041-d378-4916-a2d4-d634e7655657 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.490037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b842041-d378-4916-a2d4-d634e7655657 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.490037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b842041-d378-4916-a2d4-d634e7655657 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.490037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 538/1043] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:46.492014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.494870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.495156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.495432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.515297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:46.516455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:46.526320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.591147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 539/1044] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:46.601588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a65124-c680-45df-a8b4-7aa81cce523b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.614333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.641187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.642267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.642731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.643185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.650913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.652946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:46.665697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:46.666685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:46.667590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:46.669649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 506/1045] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:46.675259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.724829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f77f0-fceb-4891-b226-98f30298ac36 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.748480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.771481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.772711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.773364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.773848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.779600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:46.787235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:46.790473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8465c9-f564-4ef0-abd9-e2681fb3a93a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:46.792194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:46.793667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:46.795743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 540/1046] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:46.799697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.832487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.832487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.832487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.832487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.832955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:46.833231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.834661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.853724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 507/1047] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:46.854720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.916511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f57b-3d60-48ec-82d2-ac4559c2c071 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:46.953835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:46.954450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:46.954729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:46.954998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:46.955757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:46.956049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:46.957438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:46.966784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 541/1048] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:46.972139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:46.973070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991cd40-9e34-40b6-b41c-df4b8b137da7 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:47.010114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:47.010727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:47.011001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:47.011267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:47.012098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] RBAC: Adding query filter params (role.id=62108e73e2f047ca99670e1200bda1d5, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:47.012447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:47.013929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:47.017805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:47.019307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 508/1049] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=62108e73e2f047ca99670e1200bda1d5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:47.094868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2eb00-619b-4e4e-b58e-6fbb67faa92c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:47.137642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:47.138318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:47.138620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:47.138894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] PATH_INFO: `/v3/users/d269129460394318b1221d7bb259a83c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:47.155621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] RBAC: Authorizing `identity:get_user(user_id=d269129460394318b1221d7bb259a83c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:47.157107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:47.163675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 542/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:40:46 2022] GET /identity/v3/users/d269129460394318b1221d7bb259a83c => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:47.164859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:47.182211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:47.271217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1412b65-83fa-4754-b4c4-50623649132d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:47.305528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:47.306152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:47.306433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:47.306706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:47.379564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:47.381047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:47.395350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:47.481915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 509/1051] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:47 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:40:47.487782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:47.583722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:47.591213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a96d66-1147-4001-84a5-1add60188c09 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:47.625373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:47.626016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:47.626299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:47.626576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:47.627729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:47.629180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999f59-57a4-452b-a535-896a6c753e97 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:47.639637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 543/1052] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:40:47 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:47.639792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:47.740968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c7f4ea-20b9-412a-97c0-878108fe86dd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:47.755761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:47.777475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:47.778090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:47.778367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:47.778634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:47.779415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7, user.id=d269129460394318b1221d7bb259a83c) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:47.779722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:47.781155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e193ff9-5fc1-420f-9870-44ddd1039eeb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:47.792324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 510/1053] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:47 2022] GET /identity/v3/role_assignments?user.id=d269129460394318b1221d7bb259a83c&scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:48.396007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388a4d-47f3-4ba9-b03c-ddba38c7b7a7 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:48.396214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388a4d-47f3-4ba9-b03c-ddba38c7b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:48.396707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86388a4d-47f3-4ba9-b03c-ddba38c7b7a7 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:48.398208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 544/1054] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:48.403852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:48.404643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:48.405068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:48.423487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:48.424904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:48.494024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 511/1055] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:48.516210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388a4d-47f3-4ba9-b03c-ddba38c7b7a7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:48.620512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86388a4d-47f3-4ba9-b03c-ddba38c7b7a7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:48.654844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:48.655392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:48.655671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:48.655942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:48.656663 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:48.658013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:48.667116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:48.668141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 22:40:48.669499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:48.672608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 545/1056] 10.222.0.59 () {56 vars in 1105 bytes} [Mon Jul 25 22:40:48 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:48.674152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:48.776499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020e494-1b2c-4f38-9a1a-c55cd10b5c2d None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:48.786013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:48.813107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:48.813729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:48.814009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:48.814282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:48.814957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] RBAC: Adding query filter params (name=image) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:48.815267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:48.816672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:48.826333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 512/1057] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:48.827508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:48.857951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:48.939477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc7305-148d-4628-bd14-9ca4d4b910c3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:48.974003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:48.974625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:48.974904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:48.975181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:48.975855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] RBAC: Adding query filter params (type=image) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:48.976158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:48.977552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea80ca-761c-4516-ac83-ade6b03f7bda None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:48.982588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 546/1058] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:48.988401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.016542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55302d-e50f-44d6-9d59-8225ea8400fb None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.016856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55302d-e50f-44d6-9d59-8225ea8400fb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.017107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55302d-e50f-44d6-9d59-8225ea8400fb None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.018582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 547/1059] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:40:49.023222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.023505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.023790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.042453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:49.044025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:49.092976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881499-e2e2-4b0a-a378-44985c0c0a86 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.116326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 548/1060] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:49.137162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.137901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.138251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.138532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.139254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:49.139359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.140647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:49.172314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 513/1061] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:40:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:49.172554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:49.251627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c02480-1788-4d53-a917-c3eeba3652e6 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.295597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.296257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.296565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.296841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.308876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:49.314094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:49.315016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:49.315864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 549/1062] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:49.321398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.353737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:49.429305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c32e22-0045-43d1-b4f5-ceee850719d3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.465033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.465655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.465934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.466206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.466969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:49.467272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:49.468724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:49.481811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 514/1063] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:49.483381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.563230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:49.586449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bfb0b-a8fb-455f-b93c-4ed37e469a6f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.622199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.622845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.623184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.623460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.633862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:49.635312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-fa4fbd82-7027-4c6a-880b-4c3f38fae82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:49.650375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:49.651336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:49.652352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:49.652352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:49.652352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:49.652352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:49.653336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 550/1064] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:49.657640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.754344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:49.766201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426fcfd-2a74-4a56-a938-72fe9a99c9ba None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.799205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b3ef-f0e0-4212-8edf-cc11ba97d2e1 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.799485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b3ef-f0e0-4212-8edf-cc11ba97d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.799761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200b3ef-f0e0-4212-8edf-cc11ba97d2e1 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.800873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.804324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 551/1065] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:49.804460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:49.806326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.807048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.807351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.821432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 515/1066] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:49.822869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.827079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:49.828254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:49.898679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 552/1067] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:49.921383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:49.932506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fd82b-0975-4287-b2e2-010aa1cce4a8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:49.969616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:49.970258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:49.970536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:49.970804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:49.978088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:49.979519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:49.982382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:49.991938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:49.992937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:49.993883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 516/1068] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:49.998854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.011637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.028549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde063b8-fc81-4def-8d35-ea9f4f97ba58 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.065957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.066905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.067382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.067849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.079356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:50.086016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:50.087210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:50.088061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:50.092327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 553/1069] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:50.095834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.111629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363d759-66f3-4814-9afc-a449d4567aeb None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.153719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.154341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.154624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.154898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.155695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:50.156198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.157466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.179140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 517/1070] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:50.184764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.206557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fa1e4-4f58-4ff9-baf6-652d3ffeae45 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.227662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.243612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.244582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.244869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.245399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.246525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:50.247098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.248640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.257102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.257873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 554/1071] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:50.264500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.296910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48cb6b-8b6e-4b49-a1c1-29ec771a0d0a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.337546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.338101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.338376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.338645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.349868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.351767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:50.367254 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:50.368174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:50.369109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:50.369109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:50.369109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:50.369109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:50.369109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 518/1072] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:50.373296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf845ee0-8084-4856-a9d3-5d86ddf6cf79 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.374036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.411042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.411690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.411975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.412253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] PATH_INFO: `/v3/users/d269129460394318b1221d7bb259a83c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.413435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] RBAC: Authorizing `identity:get_user(user_id=d269129460394318b1221d7bb259a83c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.414871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.416603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 555/1073] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/users/d269129460394318b1221d7bb259a83c => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:50.422443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.477136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7154a-172d-4260-ba9a-5e170e95c9ec None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.478258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.498780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.514728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.515350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.515733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.516011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.516724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:50.517031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.518391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.531573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 519/1074] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:50.536012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6627f628-2a2a-46ee-b672-e23a97b0ecca None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.536996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.570426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.571648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.571931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.572208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.573386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.575335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.577162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 556/1075] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:50.583043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.656347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e534ba4-db70-4170-b7d1-435e36891f9a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.682600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c87dd-e24e-4f6b-83ec-7e6e5cd9654d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.692442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.693204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.693483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.693759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.699724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.701737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.703189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:50.716062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:50.717002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:50.717889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 520/1076] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:50.721554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.722370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.722657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.722892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:50.722989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7/users/d269129460394318b1221d7bb259a83c/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.725094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] RBAC: Authorizing `identity:create_grant(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7, user_id=d269129460394318b1221d7bb259a83c, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.726543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.752323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 557/1077] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:50 2022] PUT /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7/users/d269129460394318b1221d7bb259a83c/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:40:50.773615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:50.840240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017e9d-906b-4786-a5b3-db44a586504c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:50.877556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:50.878183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:50.878458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:50.878728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:50.879512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:50.879820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:50.881300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a917c18-c06e-4022-8951-5a76018aa1e2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:50.897114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 521/1078] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:50.907521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:51.009522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e67ec-34af-4318-81c3-003de34fd95e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:51.043385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:51.044060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.044361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.044642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/62108e73e2f047ca99670e1200bda1d5` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.046808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=0683955d11d0442cae5e9e4d4f973e10, role_id=62108e73e2f047ca99670e1200bda1d5)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:51.048236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374008-08a2-429b-ac7f-ef7cada09201 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:51.061772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 558/1079] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:40:50 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/0683955d11d0442cae5e9e4d4f973e10/roles/62108e73e2f047ca99670e1200bda1d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:40:51.241257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037992ca-2a2b-467d-adb2-b30a76a339da None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.241553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037992ca-2a2b-467d-adb2-b30a76a339da None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.241728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037992ca-2a2b-467d-adb2-b30a76a339da None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.243237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 522/1080] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:51.248367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.248661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.248938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.269394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:51.270595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:51.301528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:51.342147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 559/1081] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:51.364742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037992ca-2a2b-467d-adb2-b30a76a339da None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:51.467760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:51.472849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037992ca-2a2b-467d-adb2-b30a76a339da None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:51.507446 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:51.508075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.508317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.508550 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.576395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:51.577845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:51.670953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:51.680465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 523/1082] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:51.681865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:51.788170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefd749-03bd-4171-89bb-12e08a907fb7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:51.823111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:51.823785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.824070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.824378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.834499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:51.835939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-b63670be-9b80-4731-aa04-0f656c039aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:51.850824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:51.851825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:51.852772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:51.852772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:51.852772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:51.852772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:51.856414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 560/1083] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:51.858892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:51.959486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b0c0b-e10c-4a41-8020-262d05e0fd26 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:51.993712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:51.994329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:51.994610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:51.994887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:51.995572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:51.996485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:51.997849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd4c7-2850-436f-b6a7-986c1b5f746f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:52.009045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 524/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:52.772461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6257a-aba1-4b7c-a907-ca1892e40cf0 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:52.773058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6257a-aba1-4b7c-a907-ca1892e40cf0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:52.773058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6257a-aba1-4b7c-a907-ca1892e40cf0 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:52.774358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 561/1085] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:52.779658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:52.780083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:52.780215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:52.798486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:52.799665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:52.857987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:52.869487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 525/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:40:52.892909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6257a-aba1-4b7c-a907-ca1892e40cf0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:52.915016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:52.996154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6257a-aba1-4b7c-a907-ca1892e40cf0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.028872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.029454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.029714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.029984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.040095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-6c8f2964-d0b4-4281-b659-b22c3c0986a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:53.045671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:53.046613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:53.047452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 562/1087] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:53.052990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.071213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dad89-6604-43b4-a87a-591c01ac90cc None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.071492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dad89-6604-43b4-a87a-591c01ac90cc None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.071764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9dad89-6604-43b4-a87a-591c01ac90cc None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.073144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 563/1088] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:53.078096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.078370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.078646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.096990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:53.098250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:53.150944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df64da-38c0-49b4-bda8-ae4ef7547853 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.170526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 564/1089] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:53.184797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.185417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.185693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.185962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.186668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:53.186968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.188377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.193138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.202164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 526/1090] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:53.203201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.205414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.256268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.295142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedb072-1a4d-4752-be34-c6ede8ec3798 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.304035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a1c96-4362-445b-b145-9de1140fdc87 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.328755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.329403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.329688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.329966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.337361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.338266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.338542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.338811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] PATH_INFO: `/v3/users/d269129460394318b1221d7bb259a83c` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.340713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] RBAC: Authorizing `identity:get_user(user_id=d269129460394318b1221d7bb259a83c)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.340838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:40:53.342141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.343743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 527/1091] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/users/d269129460394318b1221d7bb259a83c => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:40:53.345748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:53.346868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:53.347713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 565/1092] 10.222.0.59 () {56 vars in 1120 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:53.349557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.352556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.419191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.446240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f3896-da37-4f92-91c0-2854fa6fae75 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.450181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7daf-553e-4a1a-8886-f69edfede7a3 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.466630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.480918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.481524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.481800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.482070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.483704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.484338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.484626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.484906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.485624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:53.485930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.487296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.495108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 566/1093] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:53.501110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.548234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.549639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.598839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e442320-1cc8-4e72-976d-9319ce5b931b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.626799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.632372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.633000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.633278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.633547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.644567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.646043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.646640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 528/1094] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:40:53.653061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:53.664505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:53.665590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:53.666505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:53.666505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:53.666505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:53.666505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:53.666505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 567/1095] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:53.671348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.675504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.752947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1968468-a5ec-4261-97ca-69265894079c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.773642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6863cf9-ce11-4a30-9f62-e40b8431cd4b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.790755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.791409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.791692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.791971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.794061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.795507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.802372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 529/1096] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:53.803322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.809552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.810170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.810450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.810723 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.811417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:53.811722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.813105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.824644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 568/1097] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:53.830180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:53.875895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.896352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:53.909054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1550e-8d33-434f-957f-f711900fe34d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.929348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cf57-6cf9-41ae-9094-3ad0c3f5542b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:53.943502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.944114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.944418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.944689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.945463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7, user.id=d269129460394318b1221d7bb259a83c) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:53.945777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.947174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.952965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 530/1098] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/role_assignments?user.id=d269129460394318b1221d7bb259a83c&scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:40:53.962541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:53.963207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:53.963487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:53.963760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:53.972671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:53.974137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:40:53.987781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:53.989099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:40:53.990484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 569/1099] 10.222.0.59 () {56 vars in 1093 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:40:53.995164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:54.106160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de823949-614b-4f1b-93fb-b459d428b764 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:54.143661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:54.144302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:54.144583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:54.144852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:54.145672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:54.145979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:54.147394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:54.165589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 531/1100] 10.222.0.59 () {56 vars in 1133 bytes} [Mon Jul 25 22:40:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:54.171611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:54.269851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446c80b-fc1f-44ae-a67e-6f058e51d351 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:54.272150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:54.303447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:54.304061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:54.304375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:54.304650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:54.370385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:54.371895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:54.473535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 570/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:54.479288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:54.491785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:54.578325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e86b-1243-4f3e-bc03-82a711e1fd14 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:54.611067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:54.611710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:54.611992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:54.612266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:54.622697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:54.624083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:40:54.639013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:54.639981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:54.641275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:40:54.641275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:40:54.641275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:40:54.641275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:54.641275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 532/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:54.645945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:54.649082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:54.743440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31904c61-ba16-4564-ac8b-2ba19e9c585b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:54.777617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:54.778240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:54.778508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:54.778781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:54.779473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:54.779772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:54.781173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:54.792300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 571/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:54.798503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:54.859627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:54.897459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13649-6c28-4f00-93c6-60767098598a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:54.930165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:54.930793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:54.931072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:54.931343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:54.938489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:54.940008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:40:54.959239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:40:54.960153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:40:54.961156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 533/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:40:54.966646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:55.027314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:55.066564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8779508-e0db-47fb-9b7f-c55b1f301aed None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:55.101060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:55.101684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:55.101968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:55.102243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:55.102990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:55.103298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:55.104755 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d56f74-5977-4e0b-950a-8411cd4a6049 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:55.117011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 572/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:55.123732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:55.224381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e02c2-31e0-44e0-8ba8-d4c1702b6c39 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:55.246113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:55.257884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:55.258497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:55.258782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:55.259058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:55.259849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] RBAC: Adding query filter params (role.id=62108e73e2f047ca99670e1200bda1d5, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=0683955d11d0442cae5e9e4d4f973e10) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:55.260161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:55.261620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5485b-fb9f-4edc-91d5-b07b7d05d53a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:55.267305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 534/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:55 2022] GET /identity/v3/role_assignments?user.id=0683955d11d0442cae5e9e4d4f973e10&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=62108e73e2f047ca99670e1200bda1d5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:55.973542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b045f-adcd-43d0-88b0-2c01d9f88bb9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:55.974056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b045f-adcd-43d0-88b0-2c01d9f88bb9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:55.974149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b045f-adcd-43d0-88b0-2c01d9f88bb9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:55.975424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 573/1107] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:55.980713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:55.981165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:55.981259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:56.000092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:56.001386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:56.069185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 535/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:56.094431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b045f-adcd-43d0-88b0-2c01d9f88bb9 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:56.194009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b045f-adcd-43d0-88b0-2c01d9f88bb9 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:56.217247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:56.227962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:56.228573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:56.228860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:56.229134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:56.230296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:56.231728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed112a5-d631-4426-9ff4-c04cdd9bc049 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:56.233336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 574/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:40:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:56.239110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:56.335440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e25f-5c57-482b-b19a-619c0b88a959 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:56.351193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:56.369150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:56.369757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:56.370033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:56.370299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:56.371551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:56.373087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f71dc-3778-487e-97be-1d7f629fead6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:56.393678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 536/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:40:56 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:40:58.415024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fe45-5343-4138-9e6a-07927b354e95 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:58.415529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fe45-5343-4138-9e6a-07927b354e95 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:58.415529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5fe45-5343-4138-9e6a-07927b354e95 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:58.416886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 575/1111] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:40:58.422121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:58.422535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:58.422674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:58.440714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:40:58.441880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:40:58.505789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 537/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:40:58.528883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5fe45-5343-4138-9e6a-07927b354e95 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:58.628270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5fe45-5343-4138-9e6a-07927b354e95 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:58.660863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:58.661494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:58.661778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:58.662058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] PATH_INFO: `/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:58.663471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] RBAC: Authorizing `identity:get_role(role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:58.664869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:58.666229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 576/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:40:58 2022] GET /identity/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:58.672453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:58.766766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd855-405d-496f-9dc0-ba0daca4ffd3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:58.768237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:58.805322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:58.805961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:58.806241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:58.806514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] PATH_INFO: `/v3/users/7bcb363971c14a4db7c3e7b5cc41a407` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:58.819939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb363971c14a4db7c3e7b5cc41a407)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:58.821405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:58.823021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 538/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:40:58 2022] GET /identity/v3/users/7bcb363971c14a4db7c3e7b5cc41a407 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:58.828815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:58.889167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:58.928511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108ce06-bade-4f57-92ce-115b498cc47e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:58.968447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:58.969060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:58.969359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:58.969614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:59.034335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:59.035756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:59.092003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:40:59.134299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 577/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:40:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:40:59.140056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:59.237003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606ab59-16bb-4b8f-a55c-f988b3cffab5 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:59.269705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:59.270338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:59.270618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:59.270891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:59.272035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:59.273493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8c6ff-6129-4565-af92-d56e455a2569 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:59.275132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 539/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:40:59 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:40:59.282004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:40:59.377063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4310ea4c-c3d8-4aa6-bda9-63c95cd3c361 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:40:59.410517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:40:59.411124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:40:59.411405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:40:59.411676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:40:59.412483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7, user.id=7bcb363971c14a4db7c3e7b5cc41a407) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:40:59.412790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:40:59.414202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea89a6-d3cd-4062-a9bf-09ca4f26172c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:40:59.419438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 578/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:40:59 2022] GET /identity/v3/role_assignments?user.id=7bcb363971c14a4db7c3e7b5cc41a407&scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:01.361866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a21a-e4a1-47e4-86d1-0426f6ca2eda None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:01.362387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a21a-e4a1-47e4-86d1-0426f6ca2eda None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:01.362474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98a21a-e4a1-47e4-86d1-0426f6ca2eda None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:01.363781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 540/1118] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:01.368777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:01.369210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:01.369310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:01.388121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:01.389266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:01.406106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:01.453678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 579/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:01.475624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98a21a-e4a1-47e4-86d1-0426f6ca2eda None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:01.503073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:01.573958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98a21a-e4a1-47e4-86d1-0426f6ca2eda None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:01.606269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:01.606884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:01.607158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:01.607425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] PATH_INFO: `/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:01.608862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] RBAC: Authorizing `identity:get_role(role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:01.610215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:01.611522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 541/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:01 2022] GET /identity/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:01.617368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:01.713402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb40a13-2063-4906-8889-18f6d20e742b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:01.746608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:01.747242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:01.747524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:01.747799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] PATH_INFO: `/v3/users/7bcb363971c14a4db7c3e7b5cc41a407` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:01.748975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb363971c14a4db7c3e7b5cc41a407)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:01.750394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:01.751958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 580/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:01 2022] GET /identity/v3/users/7bcb363971c14a4db7c3e7b5cc41a407 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:01.757524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:01.849178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:01.859540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79446c96-4608-446a-919d-22f7444af9bd None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:01.894026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:01.894665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:01.894943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:01.895216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:01.896391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:01.897816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c4323-666f-43bd-afc0-86a291315d7a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:01.899470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 542/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:01 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:01.905949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:01.929945 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:02.002562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf73c31-6f31-4b23-bd5b-e7bd202266cb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:02.034871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:02.035523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:02.035806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:02.036081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7/users/7bcb363971c14a4db7c3e7b5cc41a407/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:02.038240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] RBAC: Authorizing `identity:create_grant(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7, user_id=7bcb363971c14a4db7c3e7b5cc41a407, role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:02.039659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acc2dc-f1e9-4afa-953b-ac435902e0af None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:02.052275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 581/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:41:01 2022] PUT /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7/users/7bcb363971c14a4db7c3e7b5cc41a407/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:41:03.993340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966e35-b297-4ecd-a360-1f7cca134827 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:03.993872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966e35-b297-4ecd-a360-1f7cca134827 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:03.993872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966e35-b297-4ecd-a360-1f7cca134827 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:03.995226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 543/1124] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:04.000268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.000699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.000844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.018940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:04.020120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:04.084637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 582/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:04.107851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966e35-b297-4ecd-a360-1f7cca134827 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:04.207686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966e35-b297-4ecd-a360-1f7cca134827 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:04.239992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b8464-6d74-466c-931e-6018994e884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:04.240641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8464-6d74-466c-931e-6018994e884b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.240920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8464-6d74-466c-931e-6018994e884b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.241196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b8464-6d74-466c-931e-6018994e884b None admin] PATH_INFO: `/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.242613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8464-6d74-466c-931e-6018994e884b None admin] RBAC: Authorizing `identity:get_role(role_id=2d8b00143cc348b0bde0c5eb92e3da40)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:04.244019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b8464-6d74-466c-931e-6018994e884b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:04.245850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 544/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:04 2022] GET /identity/v3/roles/2d8b00143cc348b0bde0c5eb92e3da40 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:04.251766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:04.266178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:04.355290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841238c1-1def-4193-803a-3310aa1c6a03 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:04.388866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:04.389497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.389778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.390052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] PATH_INFO: `/v3/users/7bcb363971c14a4db7c3e7b5cc41a407` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.391200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7bcb363971c14a4db7c3e7b5cc41a407)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:04.392652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:04.394222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 583/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:04 2022] GET /identity/v3/users/7bcb363971c14a4db7c3e7b5cc41a407 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:04.399967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b8464-6d74-466c-931e-6018994e884b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:04.429531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:04.495954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b8464-6d74-466c-931e-6018994e884b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:04.527990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:04.528616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.528890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.529158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.592688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:04.594118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:04.622640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:04.687871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 545/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:04.693677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:04.771046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:04.789566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd18a-8e49-41c7-976e-25bf1a8a10b9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:04.822606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:04.823232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.823515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.823783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] PATH_INFO: `/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.824908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] RBAC: Authorizing `identity:get_project(project_id=e58f2dacfcf04d13a4531d3d13e8a5f7)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:04.826302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59458196-f9e6-4e46-b0ff-0b9aaf649128 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:04.827904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 584/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:04 2022] GET /identity/v3/projects/e58f2dacfcf04d13a4531d3d13e8a5f7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:04.833902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:04.930275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5194f3-faae-4c1b-b205-4ef2ddb09374 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:04.958852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:04.966852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:04.967904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:04.968195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:04.968506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:04.970366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] RBAC: Adding query filter params (role.id=2d8b00143cc348b0bde0c5eb92e3da40, scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7, user.id=7bcb363971c14a4db7c3e7b5cc41a407) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:04.970689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:04.972260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a9514-d2dc-42b3-aa89-5bc8e8c01436 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:04.978480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 546/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:41:04 2022] GET /identity/v3/role_assignments?user.id=7bcb363971c14a4db7c3e7b5cc41a407&scope.project.id=e58f2dacfcf04d13a4531d3d13e8a5f7&role.id=2d8b00143cc348b0bde0c5eb92e3da40 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:06.955627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a82cb-58b3-4838-b1bd-fbdee070d37e None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:06.956190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a82cb-58b3-4838-b1bd-fbdee070d37e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:06.956190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a82cb-58b3-4838-b1bd-fbdee070d37e None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:06.957551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 585/1131] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:06.962947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:06.963362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:06.963500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:06.985057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:06.986258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:07.050436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 547/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:41:07.073782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a82cb-58b3-4838-b1bd-fbdee070d37e None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:07.180530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a82cb-58b3-4838-b1bd-fbdee070d37e None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:07.213796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:07.214362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:07.214639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:07.214908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:07.216030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:07.217483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0739e-3a42-4a8f-b183-9a7994ec2ea5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:07.219036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 586/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:41:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:07.225063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:07.319603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88e98-3501-4eab-8ac0-79ae87710bc2 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:07.344566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:07.353219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:07.353827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:07.354103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:07.354416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:07.355184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:07.356650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3413d-87d6-4915-92db-ebac3541b410 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:07.382733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 548/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:41:07 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:41:09.399775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e437-6039-4e45-b974-13d2eb06d4e9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:09.400279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e437-6039-4e45-b974-13d2eb06d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:09.400279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1e437-6039-4e45-b974-13d2eb06d4e9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:09.402155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 587/1135] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:09.407424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:09.407861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:09.407962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:09.426222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:09.427391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:09.491401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 549/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:09.515793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1e437-6039-4e45-b974-13d2eb06d4e9 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:09.534029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:09.625554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1e437-6039-4e45-b974-13d2eb06d4e9 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:09.658112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:09.658686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:09.658966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:09.659241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:09.660403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:09.661828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03efbf-c27a-41b1-b22d-9b9a58f07ac6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:09.663400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 588/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:41:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:09.669821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:09.765394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e5f0-e8e2-425b-ae99-4dd9daaebda8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:09.774145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:09.799040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:09.799650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:09.799932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:09.800203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:09.800908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:09.802336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd159c1-b8a1-4b0c-ac5f-6ccb5d465775 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:09.822255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 550/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:41:09 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:41:11.827977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a79e-668b-427b-bd8a-d603492b46a9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:11.828551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a79e-668b-427b-bd8a-d603492b46a9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:11.828551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1a79e-668b-427b-bd8a-d603492b46a9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:11.829902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 589/1139] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:11.834872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:11.835298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:11.835432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:11.854683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:11.855872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:11.921712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 551/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:11.951568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1a79e-668b-427b-bd8a-d603492b46a9 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.034580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:12.051024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1a79e-668b-427b-bd8a-d603492b46a9 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.084036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.084636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.084916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.085189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.095891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:12.100843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:12.102070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:12.103182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 590/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:12.108138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.198831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:12.206057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84ecf1-1660-4ac5-b036-37adb7fb9138 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.242003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.242621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.242902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.243175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.243883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:12.244187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:12.245625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:12.253469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 552/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:12.259354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.357646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ad6c-ba6d-45fd-a5fa-406564e9a881 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.390746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d076-6037-415f-b375-e99d725747ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.391373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d076-6037-415f-b375-e99d725747ff None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.391656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d076-6037-415f-b375-e99d725747ff None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.391934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da84d076-6037-415f-b375-e99d725747ff None admin] PATH_INFO: `/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.405785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84d076-6037-415f-b375-e99d725747ff None admin] RBAC: Authorizing `identity:get_user(user_id=43e08d63d7bc415cb8bf4deb643bbd3c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:12.407219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da84d076-6037-415f-b375-e99d725747ff None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:12.408844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 591/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:12 2022] GET /identity/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:12.414476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.510061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ea3d0-380c-4832-b736-5d017d7c2d20 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.542003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.542664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.542941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.543211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.567666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:12.610032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:12.611471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:12.705775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 553/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:12.711894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d076-6037-415f-b375-e99d725747ff None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.714718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:12.807895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da84d076-6037-415f-b375-e99d725747ff None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.840055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.840718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.840996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.841269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] PATH_INFO: `/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.842405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] RBAC: Authorizing `identity:get_project(project_id=267f6c34d8114a3dbfd7491fe14d8c34)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:12.843827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14b551-86b8-49cd-94cb-55d624fb69dd None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:12.845482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 592/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:12 2022] GET /identity/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:12.851498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:12.905135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:12.947323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3cfcb-0597-4395-9b5e-f73368ced69c None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:12.980961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:12.981556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:12.981833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:12.982101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:12.982873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=267f6c34d8114a3dbfd7491fe14d8c34, user.id=43e08d63d7bc415cb8bf4deb643bbd3c) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:12.983174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:12.984602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954e55f-ad4d-4772-81c6-28587221301d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:12.989786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 554/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:41:12 2022] GET /identity/v3/role_assignments?user.id=43e08d63d7bc415cb8bf4deb643bbd3c&scope.project.id=267f6c34d8114a3dbfd7491fe14d8c34&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:14.963999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba451-3c0b-42c1-8522-20defa3602b8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:14.964582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba451-3c0b-42c1-8522-20defa3602b8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:14.964582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba451-3c0b-42c1-8522-20defa3602b8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:14.965919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 593/1147] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:14.971056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:14.971424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:14.971597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:14.989437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:14.990607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:15.055598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 555/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:15.077787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba451-3c0b-42c1-8522-20defa3602b8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:15.146701 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:15.177287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba451-3c0b-42c1-8522-20defa3602b8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:15.209902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:15.210535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:15.210815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:15.211090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:15.222168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:15.226988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:15.228089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:15.229781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 594/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:15.235080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:15.283010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:15.331324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5f22-2600-4705-9432-78d829ee456a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:15.365442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:15.366051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:15.366337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:15.366610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:15.367319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:15.367625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:15.369010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:15.377421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 556/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:15.383160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:15.480109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c06a5-2781-43fe-91d6-cdd346110467 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:15.506925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:15.512738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:15.513369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:15.513649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:15.513921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] PATH_INFO: `/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:15.515063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] RBAC: Authorizing `identity:get_user(user_id=43e08d63d7bc415cb8bf4deb643bbd3c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:15.516505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:15.518077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 595/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:15 2022] GET /identity/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:15.523670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:15.619186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f7a92-5f0e-4763-92b6-6e39a856b67b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:15.631359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:15.652268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:15.652915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:15.653196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:15.653470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] PATH_INFO: `/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:15.654597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] RBAC: Authorizing `identity:get_project(project_id=267f6c34d8114a3dbfd7491fe14d8c34)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:15.656015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eeb42f-a657-45f6-a1be-9687e75456c1 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:15.657681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 557/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:15 2022] GET /identity/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:41:15.663469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:15.758596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0bc50-f9bf-41de-9364-a151fb06df1c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:15.791899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:15.792763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:15.793043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:15.793314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] PATH_INFO: `/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34/users/43e08d63d7bc415cb8bf4deb643bbd3c/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:15.795201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] RBAC: Authorizing `identity:create_grant(project_id=267f6c34d8114a3dbfd7491fe14d8c34, user_id=43e08d63d7bc415cb8bf4deb643bbd3c, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:15.796628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad14a1b-ffde-4207-bd28-49ea6459262b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:15.808759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 596/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:41:15 2022] PUT /identity/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34/users/43e08d63d7bc415cb8bf4deb643bbd3c/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:41:17.778902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930670-b3ab-4031-869c-6c3d1ad4e7bb None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:17.779437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930670-b3ab-4031-869c-6c3d1ad4e7bb None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:17.779437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f930670-b3ab-4031-869c-6c3d1ad4e7bb None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:17.780874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 558/1154] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:17.786011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:17.786399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:17.786564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:17.804090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:17.805307 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:17.857621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:17.871912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 597/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:17.896069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930670-b3ab-4031-869c-6c3d1ad4e7bb None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.000118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f930670-b3ab-4031-869c-6c3d1ad4e7bb None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.032779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.033341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.033616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.033887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.044512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:18.049329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:18.050415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:41:18.051466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 559/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:18.056690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.153538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a23e32-adf8-40ef-9077-a1ca1fb4a6c3 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.186854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.187457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.187733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.188002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.188732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:18.189031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:18.190374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:18.198065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 598/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:18.203946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.245243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:18.301042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2c512-5ec5-4a14-ba58-691eba0d7add None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.332817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.333442 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.333719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.333989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] PATH_INFO: `/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.335115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] RBAC: Authorizing `identity:get_user(user_id=43e08d63d7bc415cb8bf4deb643bbd3c)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:18.336815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:18.338416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 560/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:18 2022] GET /identity/v3/users/43e08d63d7bc415cb8bf4deb643bbd3c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:18.344341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.392615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:18.440295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe01d-d0f0-48ab-8dd3-ac20bdb7f430 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.472239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.472873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.473150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.473426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.537217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:18.538633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:18.583871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:18.632863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 599/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:18.639387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.734699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b299f-d020-4fd8-ba54-8bb50eb63aab None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.743186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:18.768025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.768672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.768949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.769219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] PATH_INFO: `/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.770339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] RBAC: Authorizing `identity:get_project(project_id=267f6c34d8114a3dbfd7491fe14d8c34)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:18.771749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815ba9-ed66-4647-97f5-82d20a871ade None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:18.773394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 561/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:18 2022] GET /identity/v3/projects/267f6c34d8114a3dbfd7491fe14d8c34 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:18.779358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:18.876018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf28c1-4d3d-413f-9578-1a5e1182135f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:18.914946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:18.915564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:18.915848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:18.916127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:18.917454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=267f6c34d8114a3dbfd7491fe14d8c34, user.id=43e08d63d7bc415cb8bf4deb643bbd3c) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:18.917762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:18.919180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8944a9-5357-4960-8aa4-754a465a0089 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:18.924902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 600/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:41:18 2022] GET /identity/v3/role_assignments?user.id=43e08d63d7bc415cb8bf4deb643bbd3c&scope.project.id=267f6c34d8114a3dbfd7491fe14d8c34&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:20.927415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea863-bdc1-4e23-8336-d04d9e0ca125 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:20.927974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea863-bdc1-4e23-8336-d04d9e0ca125 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:20.927974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ea863-bdc1-4e23-8336-d04d9e0ca125 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:20.929373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 562/1162] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:20.934505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:20.934923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:20.935060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:20.952884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:20.954068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:20.963777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:21.020522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 601/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:21.042603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea863-bdc1-4e23-8336-d04d9e0ca125 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:21.144716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ea863-bdc1-4e23-8336-d04d9e0ca125 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:21.177753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:21.178302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:21.178579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:21.178851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:21.222384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:21.244132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:21.245673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:21.340256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 563/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:21.346286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:21.441502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f89f94-9380-416d-96b9-3edf116bfeec None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:21.475005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:21.475633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:21.475912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:21.476185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:21.482706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:21.484136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-2014779f-636c-4557-94b4-c56ebcc603c2 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:21.496008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:21.497267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:21.498325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 602/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:41:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:21.503306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:21.578280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:21.600563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480d44e-d1b4-43dc-a236-34a8848a4685 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:21.633257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:21.633858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:21.634140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:21.634416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:21.635711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:21.636019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:21.637454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08188763-1e1f-42c3-a300-81573fedfa16 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:21.646611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 564/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Mon Jul 25 22:41:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:23.614244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d1c-4338-492f-8f22-f3e41177bdfc None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:23.614774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d1c-4338-492f-8f22-f3e41177bdfc None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:23.614774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62821d1c-4338-492f-8f22-f3e41177bdfc None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:23.616158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 603/1167] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:23.622012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ced7-489e-41bb-a791-70681ca4043e None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:23.622443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ced7-489e-41bb-a791-70681ca4043e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:23.622554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ced7-489e-41bb-a791-70681ca4043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:23.641687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c150ced7-489e-41bb-a791-70681ca4043e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:23.642886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c150ced7-489e-41bb-a791-70681ca4043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:23.711119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 565/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:23.734099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821d1c-4338-492f-8f22-f3e41177bdfc None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:23.737910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:23.843246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62821d1c-4338-492f-8f22-f3e41177bdfc None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:23.882974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:23.883534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:23.883811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:23.884083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:23.885419 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:23.886759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad8104-aa87-4d0b-9a6c-47ff9209d04b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:23.903456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 604/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Mon Jul 25 22:41:23 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:41:25.933227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75abe-7345-4bad-bae5-5b79b449288f None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:25.933772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75abe-7345-4bad-bae5-5b79b449288f None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:25.933772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75abe-7345-4bad-bae5-5b79b449288f None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:25.935137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 566/1170] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:25.940115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:25.940583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:25.940688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:25.958343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:25.959519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:26.016162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:26.025032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 605/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:26.048465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75abe-7345-4bad-bae5-5b79b449288f None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:26.119428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:26.151333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75abe-7345-4bad-bae5-5b79b449288f None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:26.184037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:26.184630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:26.184907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:26.185178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] PATH_INFO: `/v3/domains/7b8cd709f8264b62b508e1acf6b6ab98` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:26.195137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=7b8cd709f8264b62b508e1acf6b6ab98)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:26.196591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27655350-9322-49e5-8031-6efcb5d4edaa None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:26.198180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 567/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Mon Jul 25 22:41:26 2022] GET /identity/v3/domains/7b8cd709f8264b62b508e1acf6b6ab98 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:26.204026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:26.300162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a7757-43eb-48d4-81e1-8b51cca67b06 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:26.332573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:26.333179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:26.333459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:26.333732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:26.334413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:26.335833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b228-30b1-43cd-bc4b-99389a1117c3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:26.361219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 606/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:41:26 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:41:28.351020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72d1-6625-4fb7-8be1-1c8456228e94 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:28.351563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72d1-6625-4fb7-8be1-1c8456228e94 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:28.351563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7a72d1-6625-4fb7-8be1-1c8456228e94 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:28.352926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 568/1174] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:28.358573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:28.358989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:28.359120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:28.377034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:28.378200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:28.418816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:28.443825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 607/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:41:28.468108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a72d1-6625-4fb7-8be1-1c8456228e94 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:28.564956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7a72d1-6625-4fb7-8be1-1c8456228e94 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:28.593097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:28.598679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:28.599301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:28.599576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:28.599843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] PATH_INFO: `/v3/domains/7b8cd709f8264b62b508e1acf6b6ab98` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:28.600976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7b8cd709f8264b62b508e1acf6b6ab98)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:28.602387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0e7cc-c900-480d-aab2-4789647ec438 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:28.603960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 569/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Mon Jul 25 22:41:28 2022] GET /identity/v3/domains/7b8cd709f8264b62b508e1acf6b6ab98 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:28.609762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:28.706591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcf981-6992-4bb1-a10b-87edbddec274 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:28.739219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:28.739830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:28.740112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:28.740535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:28.741214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:28.742636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb4a36-44a7-43e5-b613-d2b3069cbf93 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:28.763130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 608/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:41:28 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:41:30.770889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c57a-d1ec-4a24-ad0b-fd974a43f6f0 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:30.771418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c57a-d1ec-4a24-ad0b-fd974a43f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:30.771418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993c57a-d1ec-4a24-ad0b-fd974a43f6f0 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:30.772813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 570/1178] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:30.777913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:30.778327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:30.778464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:30.797444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:30.798624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:30.823791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:30.864238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 609/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:30.886960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c57a-d1ec-4a24-ad0b-fd974a43f6f0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:30.984595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993c57a-d1ec-4a24-ad0b-fd974a43f6f0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.017441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.018068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.018351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.018626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.028506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:31.033373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:31.034491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:41:31.035678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 571/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:31.040225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:31.135765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9a7f8-acdf-4832-b847-c08220a0cbc2 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.172803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.173424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.173708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.173983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.174697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:31.175001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:31.176387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:31.184271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 610/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:31.190045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:31.248306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:31.287910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb69a-18fc-45e4-956b-ea4c22a6fa7f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.320481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.321104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.321377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.321643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] PATH_INFO: `/v3/users/f9478e63f81b4e239182166f14372f6c` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.334350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] RBAC: Authorizing `identity:get_user(user_id=f9478e63f81b4e239182166f14372f6c)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:31.335783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:31.338355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 572/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:31 2022] GET /identity/v3/users/f9478e63f81b4e239182166f14372f6c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:31.344198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:31.369743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:31.446192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca4e6e-b436-4c52-8934-29b355d464c1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.479697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.480345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.480629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.480906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.545951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:31.547329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:31.569805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:31.642737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 611/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:31.648582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:31.745773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fb544-9f37-4c45-a5e0-8bb9600231ef None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.761817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:31.779608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.780260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.780565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.780834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] PATH_INFO: `/v3/projects/e07732bcd4ce492099766e042c5ce94a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.781957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e07732bcd4ce492099766e042c5ce94a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:31.783371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e178b06-968c-4e64-b5fc-4b47728079d2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:31.785040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 573/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:31 2022] GET /identity/v3/projects/e07732bcd4ce492099766e042c5ce94a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:31.791266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:31.886322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2427cb-4c45-4281-8539-e0709bdbddf9 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:31.909005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:31.919850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:31.920488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:31.920767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:31.921038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:31.921818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=e07732bcd4ce492099766e042c5ce94a, user.id=f9478e63f81b4e239182166f14372f6c) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:31.922123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:31.923535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992cf32-2f67-46c1-8c3b-f3962b20d650 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:31.928749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 612/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:41:31 2022] GET /identity/v3/role_assignments?user.id=f9478e63f81b4e239182166f14372f6c&scope.project.id=e07732bcd4ce492099766e042c5ce94a&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:33.890434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167984fb-f6f9-4930-8cf0-4a58f86b6c8b None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:33.890990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167984fb-f6f9-4930-8cf0-4a58f86b6c8b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:33.890990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167984fb-f6f9-4930-8cf0-4a58f86b6c8b None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:33.892336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 574/1186] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:33.897335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:33.897753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:33.897896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:33.916050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:33.917279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:33.983094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 613/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:34.004414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167984fb-f6f9-4930-8cf0-4a58f86b6c8b None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:34.102555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167984fb-f6f9-4930-8cf0-4a58f86b6c8b None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:34.135728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:34.136401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:34.136687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:34.136959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:34.147003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:34.152565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:34.153637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:41:34.154490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 575/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:34.159774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:34.256778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcab36c-7964-4a7d-8489-60ef562e2d33 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:34.273839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:34.290610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:34.291308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:34.291590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:34.291872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:34.292622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:34.292929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:34.294288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:34.302063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 614/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:34.308264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:34.353959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:34.407884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdf3c8-d61f-4f6f-856d-ad530f47462e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:34.440716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:34.441341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:34.441621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:34.441893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] PATH_INFO: `/v3/users/f9478e63f81b4e239182166f14372f6c` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:34.443024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] RBAC: Authorizing `identity:get_user(user_id=f9478e63f81b4e239182166f14372f6c)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:34.444476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:34.446071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 576/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:34 2022] GET /identity/v3/users/f9478e63f81b4e239182166f14372f6c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:34.452491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:34.549976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534e93-18df-45dc-9020-7a8f87aef73b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:34.582620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:34.583251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:34.583536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:34.583814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] PATH_INFO: `/v3/projects/e07732bcd4ce492099766e042c5ce94a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:34.584970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] RBAC: Authorizing `identity:get_project(project_id=e07732bcd4ce492099766e042c5ce94a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:34.586660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdf1f2-b9b7-4b51-a81a-37f0ef9d5e82 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:34.588468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 615/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:34 2022] GET /identity/v3/projects/e07732bcd4ce492099766e042c5ce94a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:34.594535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:34.695802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0a442-14ea-4c27-904f-6f06eb2ad26e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:34.708620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:34.730089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:34.730751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:34.731033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:34.731309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] PATH_INFO: `/v3/projects/e07732bcd4ce492099766e042c5ce94a/users/f9478e63f81b4e239182166f14372f6c/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:34.733258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e07732bcd4ce492099766e042c5ce94a, user_id=f9478e63f81b4e239182166f14372f6c, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:34.734710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda4eff-fe92-4fe6-8a0e-63199265bbe7 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:34.747994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 577/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:41:34 2022] PUT /identity/v3/projects/e07732bcd4ce492099766e042c5ce94a/users/f9478e63f81b4e239182166f14372f6c/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:41:36.709306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e548c-4ad8-4dc8-a8cf-4974fe8eeb30 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:36.709888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e548c-4ad8-4dc8-a8cf-4974fe8eeb30 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:36.709888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e548c-4ad8-4dc8-a8cf-4974fe8eeb30 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:36.711447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 616/1193] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:41:36.716645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:36.717059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:36.717197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:36.735464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:41:36.736700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:41:36.801032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 578/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:41:36.823971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e548c-4ad8-4dc8-a8cf-4974fe8eeb30 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:36.873343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:36.923070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e548c-4ad8-4dc8-a8cf-4974fe8eeb30 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:36.955738 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:36.956385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:36.956666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:36.956935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:36.968100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:41:36.972910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:41:36.974078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:41:36.975195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 617/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:41:36.980315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:37.075384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bdc97-7c07-4cbd-8f8f-7940d5a69ea8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:37.076866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:37.109593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:37.110205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:37.110478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:37.110744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:37.111445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:37.111745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:37.113132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:37.120940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 579/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:37.126630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:37.223044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf9ef-4379-4a97-af1f-5b893380a1eb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:37.231547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:37.256193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:37.256849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:37.257128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:37.257399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] PATH_INFO: `/v3/users/f9478e63f81b4e239182166f14372f6c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:37.258532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] RBAC: Authorizing `identity:get_user(user_id=f9478e63f81b4e239182166f14372f6c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:37.260828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:37.262407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 618/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Mon Jul 25 22:41:37 2022] GET /identity/v3/users/f9478e63f81b4e239182166f14372f6c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:37.268332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:37.364366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab400d0-8979-4ae7-99a7-ec5a8ab6cde8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:37.397455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:37.398063 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:37.398341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:37.398613 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:37.427461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:37.464670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:37.466112 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:37.560804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 580/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:41:37.566632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:37.662324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a38785f-662d-4c8e-9aa7-078358bf379e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:37.698593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:37.699223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:37.699501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:37.699769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] PATH_INFO: `/v3/projects/e07732bcd4ce492099766e042c5ce94a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:37.700911 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] RBAC: Authorizing `identity:get_project(project_id=e07732bcd4ce492099766e042c5ce94a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:37.702326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2da21-0693-4667-95eb-323b11e3a93c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:37.703955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 619/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Mon Jul 25 22:41:37 2022] GET /identity/v3/projects/e07732bcd4ce492099766e042c5ce94a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:37.710214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:41:37.769728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:37.805668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5774246-a456-48c5-85e4-fa996bc760cf None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:41:37.838665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:41:37.839211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:41:37.839487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:41:37.839757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:41:37.840563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=e07732bcd4ce492099766e042c5ce94a, user.id=f9478e63f81b4e239182166f14372f6c) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:41:37.840868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:41:37.842298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdeff14-5823-4414-a3ce-d387676c04be None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:41:37.847846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 581/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:41:37 2022] GET /identity/v3/role_assignments?user.id=f9478e63f81b4e239182166f14372f6c&scope.project.id=e07732bcd4ce492099766e042c5ce94a&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:41:47.694377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=78 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:41:47.845337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=36 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:32.447968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160967-c306-49fe-a95c-a509cca204fb None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:32.448827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160967-c306-49fe-a95c-a509cca204fb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:32.448827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160967-c306-49fe-a95c-a509cca204fb None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:32.449930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 620/1201] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:32.455704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:32.456190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:32.456276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:32.479069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:32.480171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:32.569699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 582/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 22:42:32.596159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e160967-c306-49fe-a95c-a509cca204fb None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:32.739436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e160967-c306-49fe-a95c-a509cca204fb None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:32.785005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:32.785651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:32.785927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:32.786198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:32.799782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:32.801487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:32.819730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:32.820981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:32.822166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:32.822166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:32.822166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:32.822166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:32.822166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 621/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:32.828569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:32.981603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40b5b0-3898-4ad9-8e67-5ba1057362ba None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:33.028347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:33.035514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:33.036150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:33.036464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:33.036850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:33.037452 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:33.037736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:33.039163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b199433-ec20-4fae-9015-974e21984fc5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:33.052638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 583/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:33.058886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:33.124140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:33.193350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f63b-1bde-45c9-873d-a206ee093276 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:33.233960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:33.234588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:33.234903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:33.235152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:33.235837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:33.237317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436d9be-c605-4e2e-bf0b-638de5b0dfbb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:33.272531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 622/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Mon Jul 25 22:42:33 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:42:35.533282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7762a2-a35a-4b68-b33f-42cedfbde489 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:35.533937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7762a2-a35a-4b68-b33f-42cedfbde489 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:35.533937 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7762a2-a35a-4b68-b33f-42cedfbde489 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:35.535095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 584/1206] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:35.541401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:35.541848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:35.541987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:35.561381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:35.562708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:35.643898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 623/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:35.667805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7762a2-a35a-4b68-b33f-42cedfbde489 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:35.790005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7762a2-a35a-4b68-b33f-42cedfbde489 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:35.831033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:35.831709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:35.831989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:35.832264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:35.847886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:35.853466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:35.854634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:35.855494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 585/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:35.865524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:35.919392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:36.005147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba83f57-8636-41ab-8a43-7b5abe293b57 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:36.056571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:36.057134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:36.057447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:36.057683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:36.058411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:36.058708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:36.060183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:36.078828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 624/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:36.080998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:36.150135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:36.225312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032eca-e4e4-4b3b-8e80-ca49e32ee8d8 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:36.270615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:36.271587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:36.271953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:36.272262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:36.287409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:36.289758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:36.306895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:36.307872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:36.309301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:36.309301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:36.309301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:36.309301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:36.309301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 586/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:36.317451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:36.446952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:36.450286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40fa7-a05d-481e-8dc1-a641e197569b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:36.493365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:36.494931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:36.494931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:36.494931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:36.495800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:36.496242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:36.497934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:36.513323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 625/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:36.519574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:36.636902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce3e0e-34dc-4284-8f4d-ce60b95c2956 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:36.638649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:36.677637 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:36.678606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:36.678885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:36.679174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] PATH_INFO: `/v3/users/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:36.687639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:36.689666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:36.703983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:36.705109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:36.706137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 587/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:36.712963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:36.829588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b37462-7f2d-4cd3-90ea-76a33662c476 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:36.872323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:36.872323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:36.872323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:36.872323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:36.872759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:36.872759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:36.873494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:36.895325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 626/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:42:36.902632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:37.019450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a641d6-f742-42be-8228-32ce28b88cec None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:37.055533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:37.056154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:37.056467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:37.056736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:37.092827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:37.143660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:37.145639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:37.273627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 588/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:42:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:42:37.279809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:37.302164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:37.398922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf722-515c-4a82-a2f4-6711a8fa1e80 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:37.438881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:37.439713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:37.440099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:37.440543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:37.454509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:37.456143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:37.472748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:37.473965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:37.475035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:37.475035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:37.475035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:37.475035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:37.475035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 627/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:42:37.481351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:37.561002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:37.600728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc76783f-474d-4aca-bfc7-2eae8352cf80 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:37.636298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:37.636930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:37.637491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:37.637491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:37.638132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:37.638432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:37.639801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:37.656089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 589/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:37.657497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:37.736536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:37.775743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d14de-cc91-47f7-8843-8e21d4963d73 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:37.810578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:37.811306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:37.811655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:37.811997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:37.818942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:37.821000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:37.832553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:37.834468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:37.836338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:37.839710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 628/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:37.840978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:37.958600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba5d01-3c26-462a-85b2-d8d37a4c8a7f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:37.982462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:37.994966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:37.995584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:37.995905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:37.996142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:37.996922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:37.997262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:37.998680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74f5dd-1f9f-43b0-9332-d514d4610927 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:38.011620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 590/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:38.017638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:38.124847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e53b0-60ab-4a26-9a08-ab21f5487419 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:38.155707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:38.162818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:38.163666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:38.164069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:38.164524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:38.165596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=dcb9edc853614b11b608904ee161a42e) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:38.166098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:38.167585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037370b-5f94-4d63-9cb0-699aea1dd966 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:38.173734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 629/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:42:38 2022] GET /identity/v3/role_assignments?user.id=dcb9edc853614b11b608904ee161a42e&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:40.437315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e5e-8591-4c63-b85a-3a5c95eafe20 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:40.437315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e5e-8591-4c63-b85a-3a5c95eafe20 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:40.437315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc83e5e-8591-4c63-b85a-3a5c95eafe20 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:40.438816 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 591/1220] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:40.444140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:40.444720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:40.444817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:40.464732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:40.466039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:40.538174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 630/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:40.561509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83e5e-8591-4c63-b85a-3a5c95eafe20 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:40.671665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc83e5e-8591-4c63-b85a-3a5c95eafe20 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:40.705311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:40.705867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:40.706142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:40.706411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:40.717635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:40.722854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:40.724142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:40.725114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 592/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:42:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:40.731807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:40.835037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d145133-4ee3-471e-bcc5-c404d4491346 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:40.862665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:40.876146 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:40.876892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:40.877265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:40.877548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:40.878649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] RBAC: Adding query filter params (name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:40.878896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:40.880587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:40.892456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 631/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:42:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:40.896660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:40.943293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:41.004482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839802-a041-4455-a9d6-0b440609aa71 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.044686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.045322 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.045603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.045874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.056549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.057997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:41.075276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:41.077278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:41.079143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:41.079143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:41.079143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:41.079143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:41.079143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 593/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:41.085700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.189404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4a2c6-69f8-45e3-95f5-53cb7f3ae38d None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.226441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.227318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.227709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.228073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.229118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:41.229561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.231407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.245339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 632/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:41.251073 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.350110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:41.358080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c55900-3a30-4c38-9a0a-68cbc2e09d55 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.395138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.395783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.396064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.396410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.405337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.407129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:41.422628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:41.423795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:41.424749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 594/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:41.431086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.482104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:41.537542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35e739-4a3f-4311-992a-0401922dba40 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.578206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.578827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.579127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.579370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.580157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:41.580486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.581919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.603561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 633/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:41.607185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.720481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d539eb0-0fd3-4a33-8438-e6ae66d9fad6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.764481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.765134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.765416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.765690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.778000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.782248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:41.798331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:41.799491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:41.800950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:41.800950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:41.800950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:41.800950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:41.800950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 595/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:41.805638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.924105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c2b24-e93b-4e60-bc27-6bb3b7114b1e None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:41.927018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:41.959349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:41.960776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:41.961105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:41.961384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:41.962092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:41.962387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:41.963790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:41.978222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 634/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:41.984819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:41.998036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:42.102781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c62c5a-9c5e-4766-8821-cdb33dfeb4ee None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:42.141060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:42.141806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:42.142028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:42.142273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:42.150437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:42.151860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:42.163456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:42.164829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:42.165932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 596/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:42.170677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:42.278803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea6e9-9329-45b2-9494-e0e13b311d40 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:42.317635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:42.318234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:42.318580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:42.318855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:42.319962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:42.320584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:42.322432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131942-0ca7-4ba4-8d16-04a0fb29fd6f None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:42.336805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 635/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:42.344401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:42.414279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:42.453197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee617c-90ec-46f9-bbcf-be4cf7650f21 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:42.493627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:42.494532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:42.494934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:42.495323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/dcb9edc853614b11b608904ee161a42e/roles/9494e34423564eb6ad29533a91ec989b` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:42.511707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=dcb9edc853614b11b608904ee161a42e, role_id=9494e34423564eb6ad29533a91ec989b)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:42.513401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3567b885-e342-44ad-af64-6494825879b4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:42.527522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 597/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:42:42 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/dcb9edc853614b11b608904ee161a42e/roles/9494e34423564eb6ad29533a91ec989b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:42:44.621988 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236abfe-ef3e-4f89-bac0-f3ef370790ac None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:44.622527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236abfe-ef3e-4f89-bac0-f3ef370790ac None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:44.622527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236abfe-ef3e-4f89-bac0-f3ef370790ac None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:44.623883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 636/1233] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:44.629122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:44.629558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:44.629707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:44.648139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:44.649348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:44.719021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 598/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:44.743210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236abfe-ef3e-4f89-bac0-f3ef370790ac None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:44.771643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:44.854720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236abfe-ef3e-4f89-bac0-f3ef370790ac None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:44.902664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:44.903340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:44.903725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:44.904037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:44.919794 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:44.924841 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:44.925996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:44.926882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 637/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Mon Jul 25 22:42:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:44.933558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:44.988864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:45.047278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc5a46-ebfa-45c3-823b-b69837914389 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.084139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.085053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.085337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.085634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:45.086342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] RBAC: Adding query filter params (name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:45.086648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:45.088021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:45.096160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 599/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Mon Jul 25 22:42:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:45.102517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:45.189284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:45.205468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2e8f-f39c-450b-b037-bd494d91616f None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.242466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.243238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.243585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.243943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:45.254541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:45.255980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:45.270549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:45.271692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:45.272942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:45.272942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:45.272942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:45.272942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:45.276450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 638/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:45.277639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:45.390623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d94ee6-f2b1-4d42-b134-9dd5e8b61715 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.400791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:45.428728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.430863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.430863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.430863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:45.430863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:45.430863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:45.432580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:45.445376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 600/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:45.451237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:45.563070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721ef9-cc6e-4d1d-887a-f697e751568b None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.599503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.600194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.600548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.601332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:45.604001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:45.609497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:45.611029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:45.623015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:45.629308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:45.630301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 639/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:45.630900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:45.740936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d500f-f079-46d2-a8fa-07fe3dc2950d None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.777719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.778460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.778745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.779026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:45.779833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:45.780154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:45.781915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:45.806031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 601/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:42:45.812154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:45.929352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0e10-1a33-4651-b0f1-77cdcf672c11 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:45.973052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:45.973898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:45.975213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:45.975213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:46.042346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:46.050104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:46.051634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:46.153785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 640/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:42:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 22:42:46.160056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:46.190591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:46.270970 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284481-347f-4b51-8118-e6517d8f2f75 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:46.307312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:46.307885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:46.308206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:46.308530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:46.319439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:46.320980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:46.336877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:46.337826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:46.339089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:46.339089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:46.339089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:46.339089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:46.339089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 602/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:46.343734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:46.443398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:46.450057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf3a47-9ece-4fc8-b873-8c3e46d9aced None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:46.490960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:46.491633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:46.491954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:46.492237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:46.492978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:46.493271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:46.494653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:46.507263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 641/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:46.513037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:46.596387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:46.617232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f2c26-af1a-4c20-b904-222e48f15229 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:46.652754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:46.653412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:46.653687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:46.653998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:46.660749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:46.662200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:46.676142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:46.677201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:46.678130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 603/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:46.683246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:46.795027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6516c06-f8c1-4fe8-aa11-536e267c0276 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:46.831040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:46.832118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:46.832473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:46.832756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:46.833645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:46.833982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:46.836733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85be6f-a38e-4cf9-a616-d34b28728e7e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:46.854515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 642/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:46.855749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:46.969408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34657e1e-0ac2-4b10-8944-2172f1055848 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:47.008004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:47.008662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:47.008960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:47.009235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:47.010024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] RBAC: Adding query filter params (role.id=9494e34423564eb6ad29533a91ec989b, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=dcb9edc853614b11b608904ee161a42e) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:47.010331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:47.011779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eadc53-c534-4c8c-a5e4-08001b6ee6fc None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:47.018584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 604/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:42:46 2022] GET /identity/v3/role_assignments?user.id=dcb9edc853614b11b608904ee161a42e&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=9494e34423564eb6ad29533a91ec989b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:49.258857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00722e1-cf19-466b-a547-806c151acf3f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:49.259439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00722e1-cf19-466b-a547-806c151acf3f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:49.259439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00722e1-cf19-466b-a547-806c151acf3f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:49.260801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 643/1247] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:42:49.266310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:49.266728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:49.266950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:49.273797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:49.289031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:49.290443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:49.366575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 605/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:49.390098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00722e1-cf19-466b-a547-806c151acf3f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:49.410263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:49.505849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00722e1-cf19-466b-a547-806c151acf3f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:49.542632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:49.543380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:49.543690 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:49.543958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:49.555990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:49.561491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:49.562477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:49.563333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 644/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:49.569054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:49.675733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce0840-900c-4f88-a9a3-4f79bcebd8b9 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:49.709842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:49.714810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:49.715558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:49.715849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:49.716133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:49.716973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:49.717285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:49.718814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:49.728696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 606/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:49.734609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:49.822925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:49.852048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112fd16-c21b-492d-8c81-7b991426efd0 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:49.894522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:49.895311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:49.895591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:49.895866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:49.909096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:49.910707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:49.928759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:49.929877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:49.931001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:49.931001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:49.931001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:49.931001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:49.931001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 645/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:42:49.934691 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:50.049274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ec2cf-38d5-45c7-913d-6b4a98d10465 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:50.085558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:50.086216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:50.086499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:50.086770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:50.087460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:50.087759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:50.089174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:50.102790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 607/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:50.108812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:50.229461 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fea8-10a9-4ace-a531-32ba639e0401 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:50.258008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:50.267806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:50.268745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:50.268956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:50.269206 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:50.278470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:50.280156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:50.294121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:50.295158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:50.296267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 646/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:42:50.302139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:50.373114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:50.424823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ba821-50ba-4f03-808a-ee8bc91e4e8b None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:50.467258 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:50.468086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:50.468560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:50.468847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:50.469641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:50.469946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:50.471384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:50.492259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 608/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:50.499694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:50.606974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051326d-58ea-4735-af72-08e1d74993eb None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:50.645777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:50.646400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:50.646687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:50.646962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:50.714229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:50.728610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:50.730070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:50.839402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 647/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:42:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:42:50.845341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:50.967478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d9cb-b834-444f-9bf6-a2dd9c9d2959 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:50.982054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:51.006398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:51.007194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:51.007478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:51.007759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:51.018156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:51.019679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:51.035857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:51.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:51.038476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:51.038476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:51.038476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:51.038476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:51.038476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 609/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:51.043526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:51.145715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:51.158604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81ec5-dd5b-4420-9859-628ef68b22aa None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:51.200302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:51.201040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:51.201372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:51.201679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:51.202471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:51.202771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:51.204266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:51.217611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 648/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:51.223552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:51.329969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81148699-7c35-47e9-a7cc-bba61d23f2ab None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:51.366472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:51.367180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:51.367499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:51.367808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:51.374888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:51.376359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:51.387594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:51.388704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:51.389975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 610/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:51.394780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:51.497785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7847b-a920-4be3-9769-84c6cd89c4c8 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:51.532387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:51.533006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:51.533282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:51.533580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:51.534319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:51.534621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:51.536035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec3921-9d9b-40f1-a192-7ec90a4e30ac None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:51.549136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 649/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:42:51.555050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:51.582391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:51.666858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6971-3204-4ba7-ae78-93610ac205c6 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:51.703438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:51.704024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:51.704249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:51.704543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:51.705325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=dcb9edc853614b11b608904ee161a42e) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:51.705638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:51.707058 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54796b45-a608-4294-a2f0-cf6e43cfe6b8 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:51.713114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 611/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:42:51 2022] GET /identity/v3/role_assignments?user.id=dcb9edc853614b11b608904ee161a42e&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:53.700862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629372a-d846-45f9-88dc-f2787b0ccf1d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:53.701393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629372a-d846-45f9-88dc-f2787b0ccf1d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:53.701393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629372a-d846-45f9-88dc-f2787b0ccf1d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:53.702760 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 650/1261] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:53.707762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:53.708197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:53.708351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:53.726351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:53.727535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:53.791898 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 612/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:53.814239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629372a-d846-45f9-88dc-f2787b0ccf1d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:53.825556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:53.920437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629372a-d846-45f9-88dc-f2787b0ccf1d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:53.953942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:53.954521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:53.954800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:53.955070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:53.965165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:53.970070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:53.971140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:53.972142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 651/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:53.977741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:53.996300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:54.073705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900c122-9f8f-40d9-aeb0-c26c49079c17 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.106398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.107007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.107288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.107569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.108306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:54.108614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.109972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.118273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 613/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:54.123808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:54.188641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:54.220259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5a412-b36d-4245-b0b7-9f1ae77f0ab5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.254533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.255160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.255440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.255715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.265471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.266902 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:54.281147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:54.282209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:54.283341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:54.283341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:54.283341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:54.283341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:54.283341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 652/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:54.287954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:54.370612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:54.389272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3f4b8-3ecf-4090-8485-089357e40d42 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.421728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.422331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.422606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.422872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.423548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:54.423848 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.425224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.436983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 614/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:54.442793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:54.539815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29964fe4-bf13-46b7-a278-88a4fa94353a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.559817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:54.573845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.574476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.574756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.575030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.583101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.584834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:54.596300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:54.597402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:54.598566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 653/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:54.603786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:54.705236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac38d0-7a79-4875-a221-63eccc882215 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.737800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.738401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.738675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.738943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.739717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:54.740018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.742060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.750373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:54.758951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 615/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:54.764580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:54.866083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f80c23-ddc8-47e1-9cea-d91d300119e6 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:54.901483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:54.902122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:54.902400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:54.902673 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:54.912924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:54.914850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:54.928612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:54.930256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:54.931348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:54.931348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:54.931348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:54.931348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:54.931348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 654/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:54.936048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:55.033570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcbae-bf00-4578-8487-6d0968795ef2 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:55.065287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:55.065890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:55.066166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:55.066434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:55.067105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:55.067403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:55.068787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:55.079997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 616/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:55.086574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:55.117503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:55.187525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6f213-1d8e-4c43-b8f5-365ff2d8b6a1 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:55.219958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:55.220621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:55.220905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:55.221180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:55.228198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:55.229662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:55.240793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:55.241834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:55.242923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 655/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:55.247762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:55.304510 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:55.344829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1b6f-600e-4c85-b554-ab00b81c0111 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:55.377115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:55.377659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:55.377938 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:55.378213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:55.378949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:55.379253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:55.380697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11408-b35d-4120-9f4d-ef9e6f4eb84f None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:55.392132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 617/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:55.398925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:55.487606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:55.496389 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9273f2e-6f29-4d6b-8e02-60a290957784 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:55.529293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:55.529942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:55.530226 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:55.530505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] PATH_INFO: `/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/dcb9edc853614b11b608904ee161a42e/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:55.532435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd2daa3b47ff4158970171cb1ee0857e, user_id=dcb9edc853614b11b608904ee161a42e, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:55.533856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c69f7-e397-4dfb-abbd-a278f758c0f4 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:55.545814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 656/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Mon Jul 25 22:42:55 2022] PUT /identity/v3/projects/cd2daa3b47ff4158970171cb1ee0857e/users/dcb9edc853614b11b608904ee161a42e/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:42:57.531664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7b43-37cd-40a5-a8d9-41876c0e8853 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:57.532162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7b43-37cd-40a5-a8d9-41876c0e8853 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:57.532162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b7b43-37cd-40a5-a8d9-41876c0e8853 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:57.533525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 618/1274] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:42:57.539147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:57.539518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:57.539708 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:57.557415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:42:57.558597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:42:57.623377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 657/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:42:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:42:57.646457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7b43-37cd-40a5-a8d9-41876c0e8853 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:57.748617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b7b43-37cd-40a5-a8d9-41876c0e8853 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:57.765165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:57.781368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:57.782041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:57.782269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:57.782539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:57.792773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 22:42:57.797578 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:57.798732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:57.799776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 619/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Mon Jul 25 22:42:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:57.805482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:57.888031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:57.907270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922260db-4a0c-44c1-898e-9f92c7d7e2e5 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:57.942872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:57.943486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:57.943765 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:57.944039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:57.945326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:57.945624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:57.946986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:57.954784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 658/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Mon Jul 25 22:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:42:57.961387 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.058894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370d50b-e424-4ecb-beac-594b1c2e3d2f None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:58.092263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:58.092913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:58.093188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:58.093457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:58.103071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:58.104576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:58.119275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:58.120349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:58.121549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:58.121549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:58.121549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:58.121549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:58.121549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 620/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 22:42:58.126153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.223352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018ab8ea-db78-4379-9048-b4646e8684f5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:58.255603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:58.256210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:58.256523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:58.256804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:58.258054 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:58.258357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:58.259711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:58.271052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 659/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:58.276727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.306602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:58.373958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dac43-ad83-4927-afdb-3435216680ff None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:58.406002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:58.406622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:58.406899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:58.407169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:58.414390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:58.415807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 22:42:58.426616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:58.427680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:42:58.428703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 621/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:58.434059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.437792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:58.530300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42ed94-40ad-4b2e-ae37-f835baf1d72c None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:58.563395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:58.564000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:58.564305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:58.564584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:58.565372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:58.565677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:58.567093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:58.583356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 660/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Mon Jul 25 22:42:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:58.589527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.677585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:58.688021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0347-df42-4454-a43c-a84e219d04a4 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:58.720076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:58.720706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:58.720981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:58.721249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:58.785500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:58.786991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:58.877273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:58.889326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 622/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Mon Jul 25 22:42:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 22:42:58.895094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:58.957495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:58.995762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de1551-2ce1-4eb5-9be4-0f5826cc217a None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:59.028674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:59.029314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:59.029597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:59.029874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:59.040263 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:59.041722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 22:42:59.055983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:59.057059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:59.058325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 22:42:59.058325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 22:42:59.058325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 22:42:59.058325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:59.058325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 661/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:42:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:59.062829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:59.161178 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718a4db-05ba-404d-aca0-b1f275f3267a None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:59.195071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:59.195678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:59.195958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:59.196231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:59.196947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:59.197250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:59.198624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:59.209782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 623/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Mon Jul 25 22:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:59.215792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:59.311648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d320e-1e31-4559-b684-898855392ab5 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:59.325151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:59.345746 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:59.346374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:59.346652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:59.346922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:59.353466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:59.354881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 22:42:59.366757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application with Lock( Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:42:59.367831 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: ERROR keystone.server.flask.application Jul 25 22:42:59.368833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 662/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Mon Jul 25 22:42:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:42:59.373540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:59.422119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:42:59.471475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376090fb-ae3c-4cf8-b771-a20fedcc6a6e None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:59.503356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:59.503960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:59.504235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:59.504531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:59.505264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:59.505648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:59.507561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363c505-0f02-443f-9fde-7798dcf3044a None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:59.519039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 624/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Mon Jul 25 22:42:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:42:59.525617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:42:59.621929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68b9e0-c87b-4c30-ad2e-1c942c802a90 None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:42:59.653950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:42:59.654544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:42:59.654821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:42:59.655091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:42:59.655862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] RBAC: Adding query filter params (role.id=e3f77a14908d48e99043f557a465098a, scope.project.id=cd2daa3b47ff4158970171cb1ee0857e, user.id=dcb9edc853614b11b608904ee161a42e) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:42:59.656166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:42:59.657596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f35aca-997d-46ce-9ea3-82d37bab0de3 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:42:59.663210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 663/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Mon Jul 25 22:42:59 2022] GET /identity/v3/role_assignments?user.id=dcb9edc853614b11b608904ee161a42e&scope.project.id=cd2daa3b47ff4158970171cb1ee0857e&role.id=e3f77a14908d48e99043f557a465098a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:01.667397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cc46c-23b6-49f3-80b4-92716ca5d4e0 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:01.667936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cc46c-23b6-49f3-80b4-92716ca5d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:01.667936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cc46c-23b6-49f3-80b4-92716ca5d4e0 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:01.669347 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 625/1288] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:01.674270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:01.674659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:01.674811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:01.692951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:01.694120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:01.722687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:01.760416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 664/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:43:01.781253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cc46c-23b6-49f3-80b4-92716ca5d4e0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:01.885148 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cc46c-23b6-49f3-80b4-92716ca5d4e0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:01.896521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:01.925015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:01.925566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:01.925843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:01.926111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:01.926767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:01.928100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:01.937874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:01.939199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:01.940366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 626/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:01.945095 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:02.041078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ec2f4-ebe5-41ce-9b7e-f9375667d363 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:02.074703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:02.075325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:02.075607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:02.075882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:02.076595 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:02.076901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:02.078259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029b1f5-b74f-409a-af31-05d0b426b3f6 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:02.083089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 665/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Jul 25 22:43:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:02.089576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:02.187171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d25b9a-8032-44b5-8917-06c62c8fd9b3 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:02.219943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:02.220568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:02.220847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:02.221119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] PATH_INFO: `/v3/services` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:02.221785 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:02.222084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:02.223438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a721f10-42fc-422f-95e0-9488a098ec38 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:02.227729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 627/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Jul 25 22:43:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:04.189269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deee333-fde0-4206-85ed-c5469e5b61a4 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:04.189771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deee333-fde0-4206-85ed-c5469e5b61a4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:04.189863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deee333-fde0-4206-85ed-c5469e5b61a4 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:04.191152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 666/1293] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:04.196114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e4a8-a283-452c-8837-a5a193a30a3d None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:04.196527 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e4a8-a283-452c-8837-a5a193a30a3d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:04.196703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524e4a8-a283-452c-8837-a5a193a30a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:04.215326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e524e4a8-a283-452c-8837-a5a193a30a3d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:04.216536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e524e4a8-a283-452c-8837-a5a193a30a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:04.245363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:04.281436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 628/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:43:04.303418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deee333-fde0-4206-85ed-c5469e5b61a4 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:04.333876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:04.409622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deee333-fde0-4206-85ed-c5469e5b61a4 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:04.442166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:04.442778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:04.443065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:04.443335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:04.444614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:04.445961 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5e7a3-b441-4100-8e0a-ee95b4486a7e None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:04.460482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 667/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Mon Jul 25 22:43:04 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:43:06.469957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db72e2-31de-4613-a1d8-09051d57bf7a None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:06.470460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db72e2-31de-4613-a1d8-09051d57bf7a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:06.470460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db72e2-31de-4613-a1d8-09051d57bf7a None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:06.471772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 629/1296] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:43:06.477492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:06.477927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:06.478052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:06.496163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:06.497386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:06.566837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 668/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:43:06.589292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db72e2-31de-4613-a1d8-09051d57bf7a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:06.686889 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db72e2-31de-4613-a1d8-09051d57bf7a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:06.719630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:06.720329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:06.720560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:06.720833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:06.721457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:06.722835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:06.731949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:06.733219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:06.734233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 630/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:43:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:06.739079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:06.757491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:06.838736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fec455-8652-4999-b99e-852bb9bc5f6b None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:06.876783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:06.877545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:06.877992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:06.878294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:06.879244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] RBAC: Adding query filter params (name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:06.879695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:06.881660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:06.888015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 669/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Jul 25 22:43:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:06.894797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:06.929692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:07.000467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04c865-d7d9-4c4f-8a6c-8b2d47dfa308 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:07.033348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:07.033963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:07.034242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:07.034511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:07.035257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] RBAC: Adding query filter params (interface=public, service_id=53369c2e3c864164becf96cfe23fda9e, region_id=RegionOne) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:07.035565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:07.036951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bb4f7-d728-4f77-97ec-1a474041aac5 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:07.041851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 631/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Mon Jul 25 22:43:06 2022] GET /identity/v3/endpoints?service_id=53369c2e3c864164becf96cfe23fda9e&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:07.047435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:07.126093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:07.144800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430168a-a3c9-417f-8c59-7acd3e226bee None admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:07.182303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:07.182918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:07.183196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:07.183470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:07.184116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:07.185538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2677a6-af31-4660-b52c-c623d48af054 None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:07.193678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 670/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Mon Jul 25 22:43:07 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:43:09.153934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce81f-e6fc-4623-8904-b166eae79a97 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:09.154427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce81f-e6fc-4623-8904-b166eae79a97 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:09.154530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ce81f-e6fc-4623-8904-b166eae79a97 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:09.155852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 632/1302] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:43:09.161007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:09.161410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:09.161556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:09.180213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:43:09.181417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:43:09.245652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 671/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:43:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 22:43:09.267088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce81f-e6fc-4623-8904-b166eae79a97 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:09.359980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:09.366978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ce81f-e6fc-4623-8904-b166eae79a97 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:09.399727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:09.400318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:09.400603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:09.400877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:09.401503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:09.402851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 22:43:09.411491 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 22:43:09.412791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application with Lock( Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self._enter() Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application return self.creator() Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application created_value = creator( Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: ERROR keystone.server.flask.application Jul 25 22:43:09.414210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 633/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Mon Jul 25 22:43:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 22:43:09.419337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:09.493420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:09.515958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7cbe2-3041-4fa4-86c4-8a40523ec1ca None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:09.549451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:09.550062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:09.550341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:09.550615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] PATH_INFO: `/v3/services` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:09.551286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] RBAC: Adding query filter params (name=placement) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:43:09.551590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:09.552975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619f359-3da1-4fd2-a3a1-bca53dc7189a None admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:09.557956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 672/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Mon Jul 25 22:43:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:43:09.563621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:43:09.660554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5011961-736f-4e53-ba9a-4a5ca71c3b90 None admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:43:09.692976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:43:09.693584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:43:09.694369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:43:09.694644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:43:09.695355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:43:09.696759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41c2cd-0953-4fa3-bcb5-fd53004675ac None admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:43:09.716121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 634/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:43:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:43:19.555199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=30 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:43:19.711936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:11.919967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f059e1-6d78-479b-8c2e-20efb87a08f2 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.920653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f059e1-6d78-479b-8c2e-20efb87a08f2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.920653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f059e1-6d78-479b-8c2e-20efb87a08f2 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:11.925805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 673/1307] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:11.927196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f1b9-7e7d-48a2-bd88-a981ce75bd52 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:11.927644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f1b9-7e7d-48a2-bd88-a981ce75bd52 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:11.927862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589f1b9-7e7d-48a2-bd88-a981ce75bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.025779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-7589f1b9-7e7d-48a2-bd88-a981ce75bd52 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:12.026943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7589f1b9-7e7d-48a2-bd88-a981ce75bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:12.152257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 635/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:44:12.212490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.213031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.213557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.215906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 674/1309] 10.222.0.59 () {54 vars in 965 bytes} [Mon Jul 25 22:44:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:12.221641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe525a-cfb4-4e57-8bdc-a7dad04d79ab None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.221914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe525a-cfb4-4e57-8bdc-a7dad04d79ab None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.222234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe525a-cfb4-4e57-8bdc-a7dad04d79ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.319009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6cbe525a-cfb4-4e57-8bdc-a7dad04d79ab None None] MFA Rules not processed for user `9fc7adc92a5b41bea6a0929eadc50689`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:12.320132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6cbe525a-cfb4-4e57-8bdc-a7dad04d79ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:12.342028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.409136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 636/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Mon Jul 25 22:44:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:12.418262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:12.420071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:12.542217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824e521-90de-4c8f-8d5a-17e56d6bfba4 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:12.620417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:12.621046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:12.621331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:12.621607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:12.623239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:12.684649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:12.744251 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:12.745731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77eb8-a41b-46ce-9474-3cac207203c5 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:12.764418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 675/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:15.093923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.094466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.094466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.095839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 637/1312] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:15.101584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd91-7ccf-4ff8-9ad3-9309a90db660 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.101976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd91-7ccf-4ff8-9ad3-9309a90db660 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.102267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd91-7ccf-4ff8-9ad3-9309a90db660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.176409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-2c17cd91-7ccf-4ff8-9ad3-9309a90db660 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:15.177629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-2c17cd91-7ccf-4ff8-9ad3-9309a90db660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:15.276070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 676/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:15.314167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:15.315759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:15.422449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979010-f24d-494e-8578-131e4d9270c8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:15.498906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:15.502130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:15.502953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:15.503466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:15.504082 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:15.506033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:15.623820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:15.625289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8029b-324e-44bd-a315-a534da755585 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:15.644315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 638/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:17.944197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.944787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.944787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:17.946123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 677/1315] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:17.951113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845458b-bcfb-4e29-ba6a-9e719a0666e1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:17.951538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845458b-bcfb-4e29-ba6a-9e719a0666e1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:17.951779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845458b-bcfb-4e29-ba6a-9e719a0666e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.016877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-3845458b-bcfb-4e29-ba6a-9e719a0666e1 None None] MFA Rules not processed for user `680759d871b04ab9abba3a7a9c3000f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:18.018104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3845458b-bcfb-4e29-ba6a-9e719a0666e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:18.069803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.116775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 639/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:18.156273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:18.157857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:18.168220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.268517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c730b03-bf30-4e49-842c-b8847788c45c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:18.350001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:18.350545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:18.350828 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:18.351104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:18.352767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:18.415194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:18.463769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:18.465252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3cdd9-9b45-425f-a125-22fdfd977ef3 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:18.485101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 678/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:21.026825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.027398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.027398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.028786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 640/1318] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:21.033942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255244c-1b03-4c83-a9a3-820bd3e6f55d None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.034827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255244c-1b03-4c83-a9a3-820bd3e6f55d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.035014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255244c-1b03-4c83-a9a3-820bd3e6f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.099835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-e255244c-1b03-4c83-a9a3-820bd3e6f55d None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:21.101105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e255244c-1b03-4c83-a9a3-820bd3e6f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:21.195130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 679/1319] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:21.233398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:21.234912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:21.336171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210c1e-748f-4ec6-8d46-1d231f0149d9 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:21.406497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:21.407100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:21.407376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:21.407718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:21.409895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:21.417028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:21.515431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:21.516913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655e2b8-3c23-4e4d-9cfb-7ebf8e263dc8 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:21.537111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 641/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:24.211930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.212490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.212490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.213861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 680/1321] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:24.219107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb42a3-6fd0-471a-bd1d-0e5e75362429 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.219554 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb42a3-6fd0-471a-bd1d-0e5e75362429 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.219793 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb42a3-6fd0-471a-bd1d-0e5e75362429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.286599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-4ecb42a3-6fd0-471a-bd1d-0e5e75362429 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:24.287788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4ecb42a3-6fd0-471a-bd1d-0e5e75362429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:24.349259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.391802 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 642/1322] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:24.428998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:24.430543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:24.451108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.544762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ce89b-41f9-4b2a-861b-85adb901b19d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:24.622161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:24.622799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:24.623080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:24.623353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:24.625024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:24.695566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:24.733391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:24.734866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ee00e8-77a0-4fb9-8b55-9028f7eca653 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:24.752560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 681/1323] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:26.828504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.829032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.829032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.830344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 643/1324] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:26.836874 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b942f4-5ef2-490d-a770-ab1975fec5dd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:26.837374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b942f4-5ef2-490d-a770-ab1975fec5dd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:26.837497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b942f4-5ef2-490d-a770-ab1975fec5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:26.915878 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-59b942f4-5ef2-490d-a770-ab1975fec5dd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:26.917157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-59b942f4-5ef2-490d-a770-ab1975fec5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:27.021216 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 682/1325] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:27.056872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:27.058444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:27.173155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1589-44e3-44c5-a17c-296fb11a3d33 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:27.256779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:27.257402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:27.257680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:27.257952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:27.259563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:27.277925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:27.388761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:27.390120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd7f44-be38-44b7-86f2-d0b57fe19737 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:27.407843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 644/1326] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:29.474162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea252-88e9-4b21-b0d0-9d5956d1fcef None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.474728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea252-88e9-4b21-b0d0-9d5956d1fcef None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.474728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ea252-88e9-4b21-b0d0-9d5956d1fcef None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.476199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 683/1327] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:29.481237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b033-76d5-4653-a965-89d04d7a8e38 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.481651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b033-76d5-4653-a965-89d04d7a8e38 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.481778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938b033-76d5-4653-a965-89d04d7a8e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.549039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-9938b033-76d5-4653-a965-89d04d7a8e38 None None] MFA Rules not processed for user `680759d871b04ab9abba3a7a9c3000f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:29.550267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9938b033-76d5-4653-a965-89d04d7a8e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:29.614758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:29.648338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 645/1328] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:29.701603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.701891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.702172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.703532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 684/1329] 10.222.0.59 () {54 vars in 965 bytes} [Mon Jul 25 22:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:29.709672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621bc24-a406-462c-abe5-c2e5b7b4a63a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:29.709966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621bc24-a406-462c-abe5-c2e5b7b4a63a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:29.710248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621bc24-a406-462c-abe5-c2e5b7b4a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:29.789413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-2621bc24-a406-462c-abe5-c2e5b7b4a63a None None] MFA Rules not processed for user `9fc7adc92a5b41bea6a0929eadc50689`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:29.790615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2621bc24-a406-462c-abe5-c2e5b7b4a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:29.866124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 646/1330] 10.222.0.59 () {58 vars in 1062 bytes} [Mon Jul 25 22:44:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:44:29.875241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:29.876821 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:29.907955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:29.983659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f5d86-06f6-4d8e-9e0c-f4a8a66580c6 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:30.056932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:30.057562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:30.057843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:30.058120 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:30.059757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:30.153143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:30.189966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:30.191421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dd15c-0375-4409-9596-003f52e7e2f9 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:30.210677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 685/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:32.842265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.842809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.842809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.844175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 647/1332] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:32.849270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbefb-ce17-4840-b627-42efb4e2071e None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:32.849653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbefb-ce17-4840-b627-42efb4e2071e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:32.849832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbefb-ce17-4840-b627-42efb4e2071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:32.914467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-939cbefb-ce17-4840-b627-42efb4e2071e None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:32.915670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-939cbefb-ce17-4840-b627-42efb4e2071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:33.011150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 686/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:33.048015 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:33.050239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:33.118971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.153772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332adc0b-f3d9-41b7-8cfe-aeba7418018a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:33.225643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:33.226253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:33.226530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:33.226800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:33.228455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:33.335399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:33.336863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb800c68-69e4-4ee9-be43-880b579b8860 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:33.347214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:33.355877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 648/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:35.404575 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.405102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.405102 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.406412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 687/1335] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:35.411556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa381e-087a-4efb-8ca6-21d400f8f6f9 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.412031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa381e-087a-4efb-8ca6-21d400f8f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.412126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa381e-087a-4efb-8ca6-21d400f8f6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.476594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-49fa381e-087a-4efb-8ca6-21d400f8f6f9 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:35.477807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-49fa381e-087a-4efb-8ca6-21d400f8f6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:35.572200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 649/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:35.613032 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:35.614573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:35.656212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.720304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0770d8-4eb8-495f-a8b9-7daaa296153f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:35.792647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:35.793262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:35.793542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:35.793815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:35.795435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:35.877067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:35.902773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:35.904215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a644842-05dd-4481-8884-3e51e1b4d664 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:35.921597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 688/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:38.398775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:38.399299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:38.399299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:38.400661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 650/1338] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:38.405742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2d9bc-5f9d-4312-aa18-c57a28947647 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:38.406138 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2d9bc-5f9d-4312-aa18-c57a28947647 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:38.406311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2d9bc-5f9d-4312-aa18-c57a28947647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:38.472019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-74d2d9bc-5f9d-4312-aa18-c57a28947647 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:38.473247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-74d2d9bc-5f9d-4312-aa18-c57a28947647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:38.567331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 689/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:38.604117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:38.605672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:38.683778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:38.712507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9c2a7-fb46-44e2-94e6-68f39409264a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:38.783548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:38.784167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:38.784477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:38.784749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:38.786350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:38.894401 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:38.895834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e0dc3b-e4d8-4413-a0c4-e2a4b03ddbe8 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:38.914318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 651/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:42.884245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.884827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.884827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.886122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 690/1341] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:42.891324 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383096ff-1b2a-4610-9a60-b9529631dc5b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:42.891782 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383096ff-1b2a-4610-9a60-b9529631dc5b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:42.891885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383096ff-1b2a-4610-9a60-b9529631dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:42.897413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:42.959989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-383096ff-1b2a-4610-9a60-b9529631dc5b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:42.961233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-383096ff-1b2a-4610-9a60-b9529631dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.058196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 652/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:43.097626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:43.099151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.148699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.208253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66caae6c-d022-428a-bf63-1fa3568636e8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:43.281533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:43.282154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:43.282438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:43.282712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:43.285027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:43.378559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:43.395784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:43.397262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf2d942-e67f-467f-9d53-ecdcfc04e270 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:43.415872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 691/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:46.030817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.031378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.031378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.032812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 653/1344] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:46.039086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856be73-db37-4963-8eb8-2e541e6ce20f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.039648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856be73-db37-4963-8eb8-2e541e6ce20f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.039648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856be73-db37-4963-8eb8-2e541e6ce20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.111719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-2856be73-db37-4963-8eb8-2e541e6ce20f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:46.112976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-2856be73-db37-4963-8eb8-2e541e6ce20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:46.221141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 692/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:46.257515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:46.259065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:46.347416 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:46.364935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28921416-d1a5-43b9-8f27-7ff13a95ead5 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:46.436775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:46.437312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:46.437621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:46.437933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:46.440566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:46.548546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:46.549996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4275944-5900-49cd-ac79-a64ead333d3b service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:46.568526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 654/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:50.443640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.444177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.444177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.445715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 693/1347] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:50.450565 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e07e7-6d26-4bc9-a1af-5586735feada None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.450989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e07e7-6d26-4bc9-a1af-5586735feada None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.451128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e07e7-6d26-4bc9-a1af-5586735feada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.467758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.520977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-946e07e7-6d26-4bc9-a1af-5586735feada None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:50.522209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-946e07e7-6d26-4bc9-a1af-5586735feada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:50.622386 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 655/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:44:50.662772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:44:50.664375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:50.724745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.773504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7427e4-ea4b-41c5-b5fe-ab47f23639cc None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:44:50.874042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:44:50.874761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:50.875134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:50.875472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:50.877847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:50.992903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:44:50.997349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:44:50.998798 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f42dfb-3ae0-45a1-9379-f1310865ff1d service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:44:51.021241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 694/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:44:56.089000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fd7b8-ea44-4513-8c0d-78e549396fff None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.089508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fd7b8-ea44-4513-8c0d-78e549396fff None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.089508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fd7b8-ea44-4513-8c0d-78e549396fff None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.091353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 656/1350] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:44:56.096436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec457-c0ee-476e-8dc2-3965e1eef9c7 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:44:56.096834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec457-c0ee-476e-8dc2-3965e1eef9c7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:44:56.097286 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec457-c0ee-476e-8dc2-3965e1eef9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:44:56.188304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-16aec457-c0ee-476e-8dc2-3965e1eef9c7 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:44:56.190294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-16aec457-c0ee-476e-8dc2-3965e1eef9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:44:56.314907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 695/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:44:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:00.282289 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917e7b-4c33-4c2a-9aab-3c9206fde168 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.283672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917e7b-4c33-4c2a-9aab-3c9206fde168 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.283955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917e7b-4c33-4c2a-9aab-3c9206fde168 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.285516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 657/1352] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:00.290468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284152d-fbde-4881-bd2f-86835a3400cf None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:00.291303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284152d-fbde-4881-bd2f-86835a3400cf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:00.291867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284152d-fbde-4881-bd2f-86835a3400cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:00.351334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:00.378600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-5284152d-fbde-4881-bd2f-86835a3400cf None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:00.380361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5284152d-fbde-4881-bd2f-86835a3400cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:00.503276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 696/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:45:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:00.620441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=59 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:01.910392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc432-07fe-46c8-aef0-8788f5641eaa None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.911006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc432-07fe-46c8-aef0-8788f5641eaa None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.911006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc432-07fe-46c8-aef0-8788f5641eaa None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.912460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 658/1354] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:01.917744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24defc-492e-40f5-a8cb-4d4d51ab1593 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:01.918503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24defc-492e-40f5-a8cb-4d4d51ab1593 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:01.918503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24defc-492e-40f5-a8cb-4d4d51ab1593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:01.998598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-8b24defc-492e-40f5-a8cb-4d4d51ab1593 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:01.999796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8b24defc-492e-40f5-a8cb-4d4d51ab1593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:02.042804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:02.109645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 697/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:45:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:05.507426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf54d-2481-4b97-90a3-55d08f6d8e79 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.507967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf54d-2481-4b97-90a3-55d08f6d8e79 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.507967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bf54d-2481-4b97-90a3-55d08f6d8e79 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.509528 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 659/1356] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:05.515137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f84f5-b4cb-432e-b731-f124a6b44a7c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.515606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f84f5-b4cb-432e-b731-f124a6b44a7c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.515689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f84f5-b4cb-432e-b731-f124a6b44a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.611140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-5b1f84f5-b4cb-432e-b731-f124a6b44a7c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:05.612417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5b1f84f5-b4cb-432e-b731-f124a6b44a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:05.716734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 698/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:05.771568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.771857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.772334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.774435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 660/1358] 10.222.0.59 () {54 vars in 962 bytes} [Mon Jul 25 22:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:05.784572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705de1-b42c-4ca6-9bff-a148df400788 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:05.784864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705de1-b42c-4ca6-9bff-a148df400788 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:05.785145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58705de1-b42c-4ca6-9bff-a148df400788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:05.804215 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:05.873494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-58705de1-b42c-4ca6-9bff-a148df400788 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:05.874819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-58705de1-b42c-4ca6-9bff-a148df400788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:06.000137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 699/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Jul 25 22:45:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:06.007987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:06.009533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:06.169631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d959-d24d-42b4-b3fb-7d9bc52b7c47 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:06.245753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:06.289933 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:06.290469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:06.290750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:06.291023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:06.292656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:06.387402 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:06.389059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350d1c5-8b87-4d40-b39f-6116bb98f557 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:06.409107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 661/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:08.632473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.632963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.633113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.636646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 700/1361] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:08.639636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715568-eca3-4adc-b08c-c5d12256c1c5 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:08.640147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715568-eca3-4adc-b08c-c5d12256c1c5 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:08.640344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d715568-eca3-4adc-b08c-c5d12256c1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:08.711043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-7d715568-eca3-4adc-b08c-c5d12256c1c5 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:08.712149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7d715568-eca3-4adc-b08c-c5d12256c1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:08.750928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:08.815406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 662/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:08.860731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:08.863980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:08.955609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.049897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206425a-3f7a-45da-ad5f-c34561c0a481 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:09.207610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:09.208241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:09.208992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:09.208992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:09.210792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:09.237997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:09.312201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:09.314351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e529b-dcd2-4eba-8532-9fc253f93f5b service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:09.333998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 701/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:11.684439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8c01-2b5b-422f-85c7-02ded01d7b1d None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.685020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8c01-2b5b-422f-85c7-02ded01d7b1d None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.685020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e8c01-2b5b-422f-85c7-02ded01d7b1d None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.686633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 663/1364] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:11.693478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e19db-c48d-441b-9ffc-de3ca3e6de71 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.693953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e19db-c48d-441b-9ffc-de3ca3e6de71 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.694045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e19db-c48d-441b-9ffc-de3ca3e6de71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.776083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-e01e19db-c48d-441b-9ffc-de3ca3e6de71 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:11.777713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e01e19db-c48d-441b-9ffc-de3ca3e6de71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:11.893671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:11.900376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 702/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:11.944157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.944622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.945199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:11.946861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 664/1366] 10.222.0.59 () {54 vars in 962 bytes} [Mon Jul 25 22:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:11.953435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50dcc-02c1-411b-af25-ac7a8226dce0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:11.953832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50dcc-02c1-411b-af25-ac7a8226dce0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:11.954274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b50dcc-02c1-411b-af25-ac7a8226dce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.034699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-b5b50dcc-02c1-411b-af25-ac7a8226dce0 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:12.036126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b5b50dcc-02c1-411b-af25-ac7a8226dce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:12.166273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 703/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Jul 25 22:45:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:12.174743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:12.176373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:12.358383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cac59-5ecb-49bb-9db0-bae021208ab7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:12.380399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:12.487968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:12.488682 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:12.488963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:12.489236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:12.490932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:12.591372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:12.593304 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59028b3f-afa6-47d2-aeb8-26070209c73f service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:12.613591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 665/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:13.589560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea5de-95c2-4e25-872b-28ccb7881dc9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.590132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea5de-95c2-4e25-872b-28ccb7881dc9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.590132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea5de-95c2-4e25-872b-28ccb7881dc9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.591774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 704/1369] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:13.596954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde5fe-da0b-4a8c-9dee-880b8277b98b None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:13.597384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde5fe-da0b-4a8c-9dee-880b8277b98b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:13.597522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badde5fe-da0b-4a8c-9dee-880b8277b98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:13.630454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:13.665800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-badde5fe-da0b-4a8c-9dee-880b8277b98b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:13.667002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-badde5fe-da0b-4a8c-9dee-880b8277b98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:13.767294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 666/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:14.115994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.116200 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.116474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.117967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 705/1371] 10.222.0.59 () {54 vars in 964 bytes} [Mon Jul 25 22:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:14.122766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a215-8b48-44dd-bb06-0766efd66be1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.123246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a215-8b48-44dd-bb06-0766efd66be1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.123633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382a215-8b48-44dd-bb06-0766efd66be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.225914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c382a215-8b48-44dd-bb06-0766efd66be1 None None] MFA Rules not processed for user `bfd0c9fabb1040cd9055b16f3504301f`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:14.227261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c382a215-8b48-44dd-bb06-0766efd66be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:14.277241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.311612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 667/1372] 10.222.0.59 () {58 vars in 1061 bytes} [Mon Jul 25 22:45:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:14.319259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:14.320856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:14.377597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.442552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231770dc-1ee6-439f-8b39-20377fe6e5f4 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:14.530154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd0c9fabb1040cd9055b16f3504301f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:14.531192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.532124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.532616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.534437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:14.640506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:14.659326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:14.660882 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b7b04-aea3-40fe-b504-5ef090fcdfd7 service cinder] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:14.681239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 706/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:14.758044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.758486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.758583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.759954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 668/1374] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:14.768409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2851-1de5-4814-bb54-3ab27bc4ef37 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:14.768409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2851-1de5-4814-bb54-3ab27bc4ef37 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:14.768409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c2851-1de5-4814-bb54-3ab27bc4ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:14.841790 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-9d3c2851-1de5-4814-bb54-3ab27bc4ef37 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:14.843037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-9d3c2851-1de5-4814-bb54-3ab27bc4ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:14.957062 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 707/1375] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:15.005863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:15.008134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.164641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cce10-a338-44cc-a7b5-d085fd9e1017 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:15.216699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:15.280788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:15.281415 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:15.281724 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:15.281986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:15.283616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:15.383517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:15.385147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a066272-f145-4cb1-861f-0cf1c64e9cf9 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:15.403483 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 669/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:17.436362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.436833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.436953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.438291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 708/1377] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:17.443522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990b09-6dac-4103-8e69-43962d6c41d7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.443975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990b09-6dac-4103-8e69-43962d6c41d7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.444186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6990b09-6dac-4103-8e69-43962d6c41d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.521732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d6990b09-6dac-4103-8e69-43962d6c41d7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:17.522956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d6990b09-6dac-4103-8e69-43962d6c41d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:17.529605 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.665306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 670/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:17.711133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:17.712762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:17.773313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:17.861238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebcf63-82a6-4780-8a32-fede7f5eb0db None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:17.985368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:17.985995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:17.986276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:17.986563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:17.988601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:18.011964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:18.101306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:18.101897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f11d8-d40f-467c-b3ae-2c80d5f0c9c2 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:18.137318 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 709/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:20.219943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.220537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.220772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.222378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 671/1380] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:20.227376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5075-a401-45bb-a4ad-d383faf33bfd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.227776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5075-a401-45bb-a4ad-d383faf33bfd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.227964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de5075-a401-45bb-a4ad-d383faf33bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.300239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-72de5075-a401-45bb-a4ad-d383faf33bfd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:20.301676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-72de5075-a401-45bb-a4ad-d383faf33bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.396840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.404228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 710/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:20.448615 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:20.450359 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.600942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.612727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f82c0-e139-4ae7-b493-88ac16b026bd None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:20.732564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:20.733222 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:20.733505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:20.733774 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:20.735428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:20.830296 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:20.832205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ad0f3e-d604-49b0-bd76-e4cebbd4c19d service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:20.843754 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:20.854083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 672/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:23.239987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.240555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.240769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.242679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 711/1383] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:23.248130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef50a9-f753-4519-b3c2-e43e53549188 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.248576 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef50a9-f753-4519-b3c2-e43e53549188 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.248742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef50a9-f753-4519-b3c2-e43e53549188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.321422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-f4ef50a9-f753-4519-b3c2-e43e53549188 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:23.322662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f4ef50a9-f753-4519-b3c2-e43e53549188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:23.428636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 673/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:23.480948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:23.482973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:23.666557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2469e-e8bd-41cb-bca8-e57119de567d None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:23.735468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:23.782411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:23.783038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:23.783319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:23.783596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:23.785300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:23.877897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:23.879507 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e440f-ab9c-40d4-8dff-9bcfc746bd03 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:23.899283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 712/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:25.919759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.920490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.920490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.922362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 674/1386] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:25.927412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17672f3-1e9e-47df-8e58-0d620507ba1c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:25.927977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17672f3-1e9e-47df-8e58-0d620507ba1c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:25.927977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17672f3-1e9e-47df-8e58-0d620507ba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:25.998022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d17672f3-1e9e-47df-8e58-0d620507ba1c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:25.999342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d17672f3-1e9e-47df-8e58-0d620507ba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:26.040403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.106973 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 713/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:26.152276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:26.153903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:26.236364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.312556 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf232e8-8c5d-4163-8cd0-17c460d28cb7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:26.427450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:26.428081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:26.428399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:26.428674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:26.430311 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:26.469277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:26.522000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:26.523620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f6c37-fe2a-4280-ab8e-df384ac33376 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:26.543899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 675/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:28.663867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.664457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.664457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.665807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 714/1389] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:28.670895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad107c-bd03-4c99-9314-142cea9f4e47 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:28.671280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad107c-bd03-4c99-9314-142cea9f4e47 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:28.671449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad107c-bd03-4c99-9314-142cea9f4e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:28.742072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-40ad107c-bd03-4c99-9314-142cea9f4e47 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:28.743283 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-40ad107c-bd03-4c99-9314-142cea9f4e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:28.844662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 676/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:28.889275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:28.891372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:29.039041 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f38e5-f6a4-44bd-933d-def4b3636572 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:29.055177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.153281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:29.153910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.154193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.154469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.156648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:29.247514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:29.249281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763fed5-2ca4-4bfd-bd5d-63f18ec23705 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:29.268514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 715/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:29.787267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6744-5993-4f68-a452-7ae5c42cd757 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.787857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6744-5993-4f68-a452-7ae5c42cd757 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.787857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f6744-5993-4f68-a452-7ae5c42cd757 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.789351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 677/1392] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:29.794393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dadd0e-7064-4756-93dc-a86b05f8c9ee None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:29.794822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dadd0e-7064-4756-93dc-a86b05f8c9ee None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:29.795030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dadd0e-7064-4756-93dc-a86b05f8c9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:29.822004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:29.865060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-48dadd0e-7064-4756-93dc-a86b05f8c9ee None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:29.866267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-48dadd0e-7064-4756-93dc-a86b05f8c9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:29.966805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 716/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:30.022726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.023171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.023521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.024983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 678/1394] 10.222.0.59 () {54 vars in 966 bytes} [Mon Jul 25 22:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:30.029925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2caaf4-4d43-4dbf-99f3-68a355ab8595 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.030218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2caaf4-4d43-4dbf-99f3-68a355ab8595 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.030499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2caaf4-4d43-4dbf-99f3-68a355ab8595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.106832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-9d2caaf4-4d43-4dbf-99f3-68a355ab8595 None None] MFA Rules not processed for user `117a0317f7994b59a6a23786c9155399`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:30.107953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-9d2caaf4-4d43-4dbf-99f3-68a355ab8595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.156985 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:30.194502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 717/1395] 10.222.0.59 () {58 vars in 1063 bytes} [Mon Jul 25 22:45:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:30.202185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:30.204276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.218298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:30.317833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde9337-455b-4f93-8049-4054f7738b35 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:30.396534 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117a0317f7994b59a6a23786c9155399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:30.397175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:30.397455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:30.397726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:30.399492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:30.468040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:30.511492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:30.512974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b063c3-4b21-4473-9cd1-bc1d06a4de79 service glance] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:30.531172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 679/1396] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:31.258587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee527-52ae-4c48-97d7-1dd2f8d73c5f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.259087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee527-52ae-4c48-97d7-1dd2f8d73c5f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.259180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee527-52ae-4c48-97d7-1dd2f8d73c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.313053 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567d6c-68d2-46cd-82d6-6fb61a719a44 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.313603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567d6c-68d2-46cd-82d6-6fb61a719a44 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.313603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e567d6c-68d2-46cd-82d6-6fb61a719a44 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.314869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 680/1397] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:31.319694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.319978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.320255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.328458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-186ee527-52ae-4c48-97d7-1dd2f8d73c5f None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:31.329664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-186ee527-52ae-4c48-97d7-1dd2f8d73c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.387009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:31.388202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.418029 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 718/1398] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:31.467409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f015-ca38-4326-bf37-8878c9ea062e None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.467694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f015-ca38-4326-bf37-8878c9ea062e None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.467972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2f015-ca38-4326-bf37-8878c9ea062e None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.469378 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 719/1399] 10.222.0.59 () {54 vars in 943 bytes} [Mon Jul 25 22:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:31.475375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.475656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.475932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.487479 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 681/1400] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:31.532431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.533871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.549225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.557619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] MFA Rules not processed for user `8d2a9820c2314fd8acbf6739408980af`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:31.558840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.561156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.674505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 720/1401] 10.222.0.59 () {58 vars in 1040 bytes} [Mon Jul 25 22:45:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:31.684169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:31.695321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e8819-95ab-43ae-b065-61aec585393f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.772377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298d1c1-189e-48d0-a301-32bb2c3de836 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:31.800468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.801203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.801486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.801758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.803477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.806013 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.893667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:31.894294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:31.894568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:31.894795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.894908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:31.896434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41145a-cc59-40d5-8e68-347e55c8bc5b service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:31.896546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:31.904371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 721/1402] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 22:45:31.918685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:31.997037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:31.998622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcc41a-54b1-4f14-a4d6-b53d89509c12 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:32.019282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 682/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:34.056107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.056787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.056787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.058060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 722/1404] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:34.064839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a1e6-d104-4638-8fdd-bdd05952a0e1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.065373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a1e6-d104-4638-8fdd-bdd05952a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.065373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a1e6-d104-4638-8fdd-bdd05952a0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.137948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-c3d3a1e6-d104-4638-8fdd-bdd05952a0e1 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:34.139172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c3d3a1e6-d104-4638-8fdd-bdd05952a0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:34.239163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.246730 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 683/1405] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:34.298979 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:34.300548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:34.462211 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:34.465427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458980e6-d0be-430f-9304-56d9d4320a71 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:34.592482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:34.593128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:34.593410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:34.593681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:34.597398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:34.692872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:34.694498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b08e8-5eba-422f-b215-cd5cc1af8b64 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:34.714223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 723/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:36.791164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.791697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.791697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.798602 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8eab9-9fa0-4f7e-8001-702cd2495aa3 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:36.799113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8eab9-9fa0-4f7e-8001-702cd2495aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:36.799208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8eab9-9fa0-4f7e-8001-702cd2495aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:36.804268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:36.804469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 684/1407] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:45:36 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:36.875621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-3aa8eab9-9fa0-4f7e-8001-702cd2495aa3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:36.876896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-3aa8eab9-9fa0-4f7e-8001-702cd2495aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:36.989219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 724/1408] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:45:37.043732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:37.043732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:37.232409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f96f-551b-4575-b38e-2f209efe33a3 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:37.307570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:37.360962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:37.361594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:37.361928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:37.362214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:37.364011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:37.470589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:37.472366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86357417-d7d4-489c-ab41-8276bca07907 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:37.501081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 685/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:45:46.987153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=64 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:47.497704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=64 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:54.165872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47eba-251e-46f0-959d-00512b71a4aa None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.166432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47eba-251e-46f0-959d-00512b71a4aa None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.166432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47eba-251e-46f0-959d-00512b71a4aa None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.167786 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 725/1410] 10.222.0.59 () {54 vars in 918 bytes} [Mon Jul 25 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:45:54.174049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478fe9-28b3-43ee-8b32-dc8121b750bf None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.174502 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478fe9-28b3-43ee-8b32-dc8121b750bf None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.174636 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea478fe9-28b3-43ee-8b32-dc8121b750bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.249627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ea478fe9-28b3-43ee-8b32-dc8121b750bf None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:54.250827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ea478fe9-28b3-43ee-8b32-dc8121b750bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:54.354918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 686/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Jul 25 22:45:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:54.369351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94dd7-0e95-4e80-92f0-64d50c66fa2a None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.369631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94dd7-0e95-4e80-92f0-64d50c66fa2a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.369908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b94dd7-0e95-4e80-92f0-64d50c66fa2a None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.371231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 726/1412] 10.222.0.59 () {54 vars in 918 bytes} [Mon Jul 25 22:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:54.375923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459441c-0a74-44a7-aba0-74df14187d64 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:54.376207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459441c-0a74-44a7-aba0-74df14187d64 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:54.376516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3459441c-0a74-44a7-aba0-74df14187d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:54.453773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:54.457325 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-3459441c-0a74-44a7-aba0-74df14187d64 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:54.459000 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3459441c-0a74-44a7-aba0-74df14187d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:54.571929 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 687/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Mon Jul 25 22:45:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:57.031142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.031674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.031674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.032972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 727/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:57.038264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583a62-da3b-4ad5-a33d-62f52ce4dca4 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.038695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583a62-da3b-4ad5-a33d-62f52ce4dca4 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.038813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15583a62-da3b-4ad5-a33d-62f52ce4dca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.103547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-15583a62-da3b-4ad5-a33d-62f52ce4dca4 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:57.104777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-15583a62-da3b-4ad5-a33d-62f52ce4dca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:57.159628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.208027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 688/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:57.251541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:57.253208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:57.398092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b91e-c9e3-46d3-8b33-9aaee96d0edb None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:57.474005 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:57.518983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:57.519610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:57.519894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:57.520173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:57.521840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:57.610523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:57.612140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0c712-74a2-4a51-b10d-b186728de31e service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:57.629761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 728/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:45:58.524539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.525084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.525084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.526373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 689/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:45:58.531712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc4c0-7acc-48c5-92cc-b8a428a3ba29 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:58.532098 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc4c0-7acc-48c5-92cc-b8a428a3ba29 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:58.532262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dc4c0-7acc-48c5-92cc-b8a428a3ba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:58.608431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-511dc4c0-7acc-48c5-92cc-b8a428a3ba29 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:45:58.609651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-511dc4c0-7acc-48c5-92cc-b8a428a3ba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.635611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:58.704712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 729/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:45:58.854368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:45:58.855780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:58.998147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08793ffd-4615-4187-831c-c8d897f5179e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:45:59.036978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:45:59.109946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:45:59.110563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:45:59.110843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:45:59.111116 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:45:59.112759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:45:59.200619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:45:59.202195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ab418-1553-4ecf-8e50-b8ba4a3b873a service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:45:59.220455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 690/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:00.105123 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:00.105660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:00.105660 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:00.106949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 730/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:00.111950 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375037-5702-4b1b-85c9-8c6c93a11499 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:00.112427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375037-5702-4b1b-85c9-8c6c93a11499 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:00.112548 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc375037-5702-4b1b-85c9-8c6c93a11499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:00.167124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:00.189376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-bc375037-5702-4b1b-85c9-8c6c93a11499 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:00.190593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-bc375037-5702-4b1b-85c9-8c6c93a11499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:00.286533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 691/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:00.449526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:00.451121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:00.594403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9dd8-bd9a-4a99-84e6-2beca618458c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:00.606365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:00.706619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:00.707166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:00.707448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:00.707722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:00.709394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:00.797978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:00.799569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c4861-3885-4af0-9f50-95c482f2a0dd service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:00.817249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 731/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:01.684991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.685845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.686023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.687433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 692/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:46:01.692568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbf97-6ab8-45e4-8a80-aee4aa17daed None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:01.692998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbf97-6ab8-45e4-8a80-aee4aa17daed None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:01.693132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bbf97-6ab8-45e4-8a80-aee4aa17daed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:01.712944 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:01.770241 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c01bbf97-6ab8-45e4-8a80-aee4aa17daed None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:01.771474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c01bbf97-6ab8-45e4-8a80-aee4aa17daed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:01.870131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 732/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:02.020505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:02.022068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:02.132066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.168299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda9bb6-79d0-4961-a250-040d0472b868 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:02.280376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:02.280920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:02.281196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:02.281462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:02.283075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:02.357246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:02.374926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:02.376545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165b75c-aedd-4451-b769-6caf205522e9 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:02.394292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 693/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:03.253484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.254026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.254026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.255400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 733/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:03.260407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335b01-ee6d-4e6b-a79e-ac05e0bce7d3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.260842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335b01-ee6d-4e6b-a79e-ac05e0bce7d3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.260940 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8335b01-ee6d-4e6b-a79e-ac05e0bce7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.336520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d8335b01-ee6d-4e6b-a79e-ac05e0bce7d3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:03.337732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d8335b01-ee6d-4e6b-a79e-ac05e0bce7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:03.432645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 694/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:03.586431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:03.587943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:03.672189 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.734714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26266-0928-4634-98be-4a29a5a7f483 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:03.845897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:03.846579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:03.846890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:03.847164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:03.848910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:03.897693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:03.938471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:03.940060 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb11ee9-f280-4584-8f93-20ebfaafdeba service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:03.957849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 734/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:04.775201 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.775858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.775858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.777170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 695/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:04.782444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454eef3-947e-426a-bbe5-c5167ebb0e61 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:04.782859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454eef3-947e-426a-bbe5-c5167ebb0e61 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:04.782986 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454eef3-947e-426a-bbe5-c5167ebb0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:04.858875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-1454eef3-947e-426a-bbe5-c5167ebb0e61 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:04.860093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1454eef3-947e-426a-bbe5-c5167ebb0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:04.955987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 735/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:46:05.105647 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:05.107117 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:05.156329 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.252844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1fa89-d358-42a3-9202-920847b358a7 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:05.362659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:05.363275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:05.363544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:05.363807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:05.365450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:05.372133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:05.453151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:05.454741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014a00-14ec-4c2b-a66a-1189b1053593 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:05.472570 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 696/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:06.272514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.273088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.273088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.274409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 736/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:06.279927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e20b-3eee-42b0-9bb1-b93e62ec6310 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.280355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e20b-3eee-42b0-9bb1-b93e62ec6310 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.280511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2e20b-3eee-42b0-9bb1-b93e62ec6310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.356124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-47c2e20b-3eee-42b0-9bb1-b93e62ec6310 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:06.357355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-47c2e20b-3eee-42b0-9bb1-b93e62ec6310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:06.423154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.452083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 697/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:06.603006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:06.604596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:06.622114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.750159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1f0e2-d11e-4914-8bce-7da3d8b04635 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:06.836436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:06.862087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:06.862716 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:06.862994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:06.863269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:06.864994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:06.953732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:06.955320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac78e1e-8cad-4717-b362-81233ee9cc73 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:06.972920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 737/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:07.772426 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.772982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.772982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.774340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 698/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:07.779610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95600-3269-4242-bae9-6f890a03cedb None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:07.780030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95600-3269-4242-bae9-6f890a03cedb None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:07.780147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95600-3269-4242-bae9-6f890a03cedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:07.854930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-97e95600-3269-4242-bae9-6f890a03cedb None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:07.856142 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-97e95600-3269-4242-bae9-6f890a03cedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:07.903499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:07.958025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 738/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:08.106563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:08.108571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:08.251522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc03a9-9f98-49ff-bac4-3f23fabe88b1 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:08.310170 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:08.369143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:08.369791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:08.370068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:08.370338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:08.371999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:08.458361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:08.459946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc7a62-fa94-4a71-826f-c813d320227f service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:08.478179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 699/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:09.279872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.280434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.280434 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.281732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 739/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:09.286740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842a67-c770-47c8-9983-f6bb2de84622 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.287143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842a67-c770-47c8-9983-f6bb2de84622 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.287320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00842a67-c770-47c8-9983-f6bb2de84622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.362729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-00842a67-c770-47c8-9983-f6bb2de84622 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:09.363946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-00842a67-c770-47c8-9983-f6bb2de84622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.365991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.459893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 700/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:09.615899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:09.617490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.762918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15ad3c-fa8d-495c-a68a-86ce36d109d8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:09.790391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:09.876588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:09.877155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:09.877439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:09.877720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:09.879356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:09.972561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:09.974140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c7e84-e86e-43d4-a77b-295bd3e440d6 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:09.991744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 740/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:11.909727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:11.910197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:11.910302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:11.911709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 701/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:11.917104 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fef6-f74f-4d94-a9b7-20278868d52b None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:11.917541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fef6-f74f-4d94-a9b7-20278868d52b None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:11.917649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9fef6-f74f-4d94-a9b7-20278868d52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:11.958573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:11.983635 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-4fa9fef6-f74f-4d94-a9b7-20278868d52b None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:11.984928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-4fa9fef6-f74f-4d94-a9b7-20278868d52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.081172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 741/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:12.119277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:12.120861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.225122 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d019-d0f0-47ca-8e67-91bfd1d93f77 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:12.257671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:12.299428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:12.300042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:12.300345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:12.300620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:12.302223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:12.409989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:12.411428 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae870c7d-f336-421f-873c-0934c1dde445 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:12.431173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 702/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:14.599805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:14.600349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:14.600349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:14.601669 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 742/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:14.607486 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade400-17bb-419a-a961-94b9f4e8dcc3 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:14.607918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade400-17bb-419a-a961-94b9f4e8dcc3 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:14.608022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceade400-17bb-419a-a961-94b9f4e8dcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:14.672390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ceade400-17bb-419a-a961-94b9f4e8dcc3 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:14.673587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ceade400-17bb-419a-a961-94b9f4e8dcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:14.688818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:14.771515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 703/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:14.809270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:14.810805 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:14.918739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df7553-6958-4e91-9d1d-cc42ca23eb3f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:14.930644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:14.991567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:14.992180 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:14.992495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:14.992770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:14.994391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:15.101027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:15.102454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1d2e9-788e-4a49-90b6-fa5f60dc4af9 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:15.121589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 743/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:17.437018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.437525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.437525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.438842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 704/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:17.444101 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab16d-1e54-4125-8288-74900a45a13f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.444536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab16d-1e54-4125-8288-74900a45a13f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.444686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eab16d-1e54-4125-8288-74900a45a13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.613070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:17.634892 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a5eab16d-1e54-4125-8288-74900a45a13f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:17.636107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a5eab16d-1e54-4125-8288-74900a45a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:17.729559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 744/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:17.768625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:17.770227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:17.873490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ede7-3f06-42a8-896f-74790219f984 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:17.914783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:17.948488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:17.949115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:17.949398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:17.949676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:17.951908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:18.065855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:18.067182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45438af-f61d-45ee-a881-cca8b029f712 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:18.085759 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 705/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:20.184547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:20.185566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:20.185683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:20.186960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 745/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:20.192192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063452df-6996-4d23-ac0d-58ea797a4fed None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:20.192601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063452df-6996-4d23-ac0d-58ea797a4fed None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:20.192768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063452df-6996-4d23-ac0d-58ea797a4fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:20.258269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-063452df-6996-4d23-ac0d-58ea797a4fed None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:20.259455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-063452df-6996-4d23-ac0d-58ea797a4fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:20.280536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:20.355230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 706/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:20.394433 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:20.395992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:20.498884 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3d586-45d3-49f5-8b1e-5a17f317f33f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:20.519811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:20.571107 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:20.571728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:20.572008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:20.572303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:20.573941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:20.691529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:20.692925 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2103dc1-7347-4a7a-a68c-ee9afae9e2a1 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:20.710709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 746/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:22.779334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:22.779873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:22.779994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:22.781330 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 707/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:22.786619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7c89-db90-44af-9703-326e2bf3bbf4 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:22.787035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7c89-db90-44af-9703-326e2bf3bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:22.787740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b7c89-db90-44af-9703-326e2bf3bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:22.850169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:22.853001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-028b7c89-db90-44af-9703-326e2bf3bbf4 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:22.854839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-028b7c89-db90-44af-9703-326e2bf3bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:22.950773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 747/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:22.988712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:22.990218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:23.092494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e464e09-546c-4415-aa16-2c73f1dbb207 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:23.141812 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:23.166454 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:23.167080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:23.167365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:23.167640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:23.169840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:23.284934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:23.287404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad416ffa-6d96-43e9-9fd3-330684ecbb60 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:23.307823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 708/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:25.362187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:25.362739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:25.362739 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:25.364144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 748/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:25.369488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128775e0-b7e9-447b-8b25-0dfa982127f7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:25.369896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128775e0-b7e9-447b-8b25-0dfa982127f7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:25.370031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128775e0-b7e9-447b-8b25-0dfa982127f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:25.434838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-128775e0-b7e9-447b-8b25-0dfa982127f7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:25.436541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-128775e0-b7e9-447b-8b25-0dfa982127f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:25.466306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:25.531788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 709/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:25.570163 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:25.571710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:25.674326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faf2d-3756-4240-97e1-b975ecb879d6 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:25.703405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:25.748679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:25.749298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:25.749581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:25.749857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:25.751477 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:25.857469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:25.859464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b0af5-0373-4809-8c4d-2176ffdbc268 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:25.877600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 749/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:27.925230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.925751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.925751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.927128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 710/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:27.932260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88221-1555-4f0e-b31b-297ecd6135c4 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:27.932702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88221-1555-4f0e-b31b-297ecd6135c4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:27.932814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a88221-1555-4f0e-b31b-297ecd6135c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:27.998526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-b2a88221-1555-4f0e-b31b-297ecd6135c4 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:27.999703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b2a88221-1555-4f0e-b31b-297ecd6135c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:28.007736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:28.101893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 750/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:28.139072 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:28.140658 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:28.241242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318329ac-c1d1-4f60-b2fd-c533d50c7dbe None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:28.295194 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:28.313093 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:28.313704 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:28.313980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:28.314249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:28.315858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:28.424894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:28.426253 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c8998-a65b-4036-89d0-646a97221a5f service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:28.444629 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 711/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:30.526369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.526947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.526947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.528179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 751/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:30.533422 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7237b0b-6ce3-410e-9b06-2b28dabc84d7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.533855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7237b0b-6ce3-410e-9b06-2b28dabc84d7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.534046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7237b0b-6ce3-410e-9b06-2b28dabc84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.599577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-a7237b0b-6ce3-410e-9b06-2b28dabc84d7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:30.600795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a7237b0b-6ce3-410e-9b06-2b28dabc84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:30.638299 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.696538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 712/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:30.734478 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:30.735978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:30.837931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec3048f-ebdf-41c8-877b-29f1b134d6d7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:30.874885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:30.910444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:30.911068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:30.911356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:30.911617 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:30.913271 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:31.020881 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:31.022326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f54a1-0663-4a5d-8ba8-edf18e463d8e service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:31.040865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 752/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:33.086981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.087532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.087532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.088919 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 713/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:33.094688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd464c-f124-4a4f-8a76-9f0a5ad6fdc0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.095140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd464c-f124-4a4f-8a76-9f0a5ad6fdc0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.095239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd464c-f124-4a4f-8a76-9f0a5ad6fdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.161050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-63bd464c-f124-4a4f-8a76-9f0a5ad6fdc0 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:33.162259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-63bd464c-f124-4a4f-8a76-9f0a5ad6fdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:33.180512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:33.258143 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 753/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:33.296050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:33.297657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:33.401047 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a7e70-e2d6-40ca-ab30-adfbed450bb0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:33.467418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:33.474581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:33.475205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:33.475484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:33.475757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:33.477403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:33.584630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:33.586078 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e247f-c670-4b6d-b14d-1b260fd992fc service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:33.605381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 714/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:46:35.616185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:35.616866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:35.616866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:35.618212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 754/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:35.624069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bffb-d7ed-4aee-81b2-7ee89ccf6d0f None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:35.624537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bffb-d7ed-4aee-81b2-7ee89ccf6d0f None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:35.624644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674bffb-d7ed-4aee-81b2-7ee89ccf6d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:35.690252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-a674bffb-d7ed-4aee-81b2-7ee89ccf6d0f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:35.691439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a674bffb-d7ed-4aee-81b2-7ee89ccf6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:35.739247 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:35.787371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 715/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:35.825108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:35.826642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:35.930375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9c0b1-52a5-4df1-8257-5b7b068f6338 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:35.976709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:36.003976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:36.004651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:36.004930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:36.005204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:36.006814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:36.114734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:36.116218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db59ad1-7227-46ca-aab5-70b477494fc1 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:36.135824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 755/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:45.785418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=22 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:46.133781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=66 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:55.566108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42eba-54da-432c-86c9-ac137212cd48 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.566753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42eba-54da-432c-86c9-ac137212cd48 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.566753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d42eba-54da-432c-86c9-ac137212cd48 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.568009 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 716/1471] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:55.573160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302496-45a0-4234-abe8-0f1ae48fa641 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.573564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302496-45a0-4234-abe8-0f1ae48fa641 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.573706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e302496-45a0-4234-abe8-0f1ae48fa641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.639218 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-7e302496-45a0-4234-abe8-0f1ae48fa641 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:55.640437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7e302496-45a0-4234-abe8-0f1ae48fa641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:55.734731 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 756/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:55.817036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.817257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.817531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.818876 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 717/1473] 10.222.0.59 () {54 vars in 966 bytes} [Mon Jul 25 22:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:55.823643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175145c-d404-4b33-b54d-5aaf6396cf7f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:55.823932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175145c-d404-4b33-b54d-5aaf6396cf7f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:55.824213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175145c-d404-4b33-b54d-5aaf6396cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:55.901699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a175145c-d404-4b33-b54d-5aaf6396cf7f None None] MFA Rules not processed for user `117a0317f7994b59a6a23786c9155399`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:55.903625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a175145c-d404-4b33-b54d-5aaf6396cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:55.923689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:55.978374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 757/1474] 10.222.0.59 () {58 vars in 1063 bytes} [Mon Jul 25 22:46:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:55.985947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:55.987501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.095270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edd8b6-e117-40c0-855d-d8563da40b73 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:56.169350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117a0317f7994b59a6a23786c9155399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:56.169964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:56.170242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:56.170515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:56.172135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:56.225276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:56.279334 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:56.280808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99241c2c-1b86-4065-b9c5-534b94e39801 service glance] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:56.298822 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 718/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:46:58.401779 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.402344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.402344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.403717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 758/1476] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:46:58.409393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4bdfd-1ecc-4c85-9dfd-f48cb9ffe6e9 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.409829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4bdfd-1ecc-4c85-9dfd-f48cb9ffe6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.409971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4bdfd-1ecc-4c85-9dfd-f48cb9ffe6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.474580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e9e4bdfd-1ecc-4c85-9dfd-f48cb9ffe6e9 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:46:58.475768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e9e4bdfd-1ecc-4c85-9dfd-f48cb9ffe6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:58.569880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 719/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:46:58.593338 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:46:58.594851 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:46:58.717921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8c74-86d9-475f-82e1-061fec3aa572 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:46:58.765661 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:46:58.817562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:46:58.818186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:46:58.818463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:46:58.818734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:46:58.819421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:46:58.821173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:46:58.821173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:46:58.821173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:46:58.822314 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973659b-aaa5-4353-b402-45f93a0cde26 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:46:58.840838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 759/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Mon Jul 25 22:46:58 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:47:00.870362 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.870939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.870939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.872297 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 720/1479] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:00.877505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034096-f410-4c18-8eab-61de7ac82fa6 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:00.877907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034096-f410-4c18-8eab-61de7ac82fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:00.878068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034096-f410-4c18-8eab-61de7ac82fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:00.943476 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c0034096-f410-4c18-8eab-61de7ac82fa6 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:00.944725 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c0034096-f410-4c18-8eab-61de7ac82fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:01.040524 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 760/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:01.083826 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:01.085440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:01.096002 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:01.229295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f62373-956a-401c-b0c0-fc1ff27985a0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:01.306969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:01.340858 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:01.341475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:01.341751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:01.342020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:01.343645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:01.430372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:01.431993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaa07f-9498-41e1-a729-243d63c94b66 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:01.450664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 721/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:03.640959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.641485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.641594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.642864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 761/1482] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:03.648103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32544-006a-4acb-96e7-012956bf77c7 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:03.648536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32544-006a-4acb-96e7-012956bf77c7 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:03.648689 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c32544-006a-4acb-96e7-012956bf77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:03.714517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b7c32544-006a-4acb-96e7-012956bf77c7 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:03.716237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b7c32544-006a-4acb-96e7-012956bf77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:03.761857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:03.812410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 722/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:03.849464 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:03.850975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:03.874810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:03.955953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc806e0e-f45e-417d-93ea-ac43cff6c0ee None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:04.027980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:04.028666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:04.028947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:04.029219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:04.030873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:04.103467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:04.137799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:04.139257 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60264808-7435-48e6-927e-5db7b6500fd7 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:04.157448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 762/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:06.193533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:06.194114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:06.194114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:06.195438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 723/1485] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:06.200808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47c27-2972-49fc-82e6-6adfaa05e1aa None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:06.201229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47c27-2972-49fc-82e6-6adfaa05e1aa None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:06.201437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47c27-2972-49fc-82e6-6adfaa05e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:06.268268 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a9e47c27-2972-49fc-82e6-6adfaa05e1aa None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:06.269484 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a9e47c27-2972-49fc-82e6-6adfaa05e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:06.367440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 763/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:06.405763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:06.407288 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:06.508920 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15df3-3aa6-4f6d-9443-29e58b46e8aa None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:06.579726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:06.581772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:06.582616 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:06.582913 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:06.583248 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:06.585265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:06.693140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:06.694493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4dc641-beb8-456c-a655-f3767d550a31 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:06.713007 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 724/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:08.854685 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.855239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.855239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.856686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 764/1488] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:08.862778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88ef8f-cd76-4831-a50e-af292b699cd2 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:08.863243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88ef8f-cd76-4831-a50e-af292b699cd2 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:08.863354 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88ef8f-cd76-4831-a50e-af292b699cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:08.931518 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ff88ef8f-cd76-4831-a50e-af292b699cd2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:08.932766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ff88ef8f-cd76-4831-a50e-af292b699cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:08.986198 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.030512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 725/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:09.073004 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:09.075223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:09.110586 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.180085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9276923-8886-4714-9b18-baaaace3f597 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:09.252421 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:09.253080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:09.253364 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:09.253641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:09.255308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:09.334657 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:09.364085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:09.365470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0331c3-db37-46dd-b197-662d3ccd21f4 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:09.383531 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 765/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:11.592719 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.593273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.593273 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.594599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 726/1491] 10.222.0.59 () {54 vars in 926 bytes} [Mon Jul 25 22:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:47:11.599796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4baf-793e-4ecb-9392-52c84442fbaf None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.600195 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4baf-793e-4ecb-9392-52c84442fbaf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.600380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f4baf-793e-4ecb-9392-52c84442fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.664916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-181f4baf-793e-4ecb-9392-52c84442fbaf None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:47:11.666119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-181f4baf-793e-4ecb-9392-52c84442fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:11.761781 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 766/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Mon Jul 25 22:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:47:11.800514 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:47:11.802051 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:11.909266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f8d7f-3f36-44bc-a233-37df7aef0b60 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:47:11.991600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:47:11.992245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:47:11.992557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:47:11.992833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:47:11.994469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:47:12.003511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:12.102977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:47:12.104441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed034032-9029-425b-a708-ebef25b14815 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:47:12.122626 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 727/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:47:21.759877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=82 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:47:22.120376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=50 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:45.497870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.498435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.498435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.577864 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:45.579083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:45.674542 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 767/1494] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:45.683179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.683671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.683766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.759308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:45.760475 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:45.855167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 728/1495] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:45.859803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:45.861046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:45.872928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e810f-2d15-4396-ae2e-4ac725edccc8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:45.935865 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:45.969893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:45.970511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:45.970783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:45.971050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:45.971728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:48:45.972028 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:45.973059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:45.973059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:48:45.973059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:48:45.973930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:45.984991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 768/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Jul 25 22:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:48:45.994030 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.003152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330413e1-83e9-4ec0-b403-114d02ae9699 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.066343 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.099651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.100264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.100574 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.101468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.102134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.103859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:46.103859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:48:46.103859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:48:46.105081 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.159696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 729/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Jul 25 22:48:45 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:46.164457 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.166020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.199108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dda12-5f85-4765-a06b-28e2428605ee admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.293472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.294087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.294361 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.294618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.295284 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.296291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:46.296291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:48:46.296291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:48:46.297494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.339083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 769/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:48:46 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:48:46.343326 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.344880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.405842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166245cc-e633-4ef3-b9d4-b7b0f7b87437 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.487150 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.499480 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.500096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.500408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.500676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.501363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.502368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:46.502368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:48:46.502368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:48:46.503243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.516027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 730/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:46.520227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.521749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.533579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9aa02-c173-4d5c-8a3e-1d8c23559b98 admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.558744 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:46.631709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.632957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.633233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.633503 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.634186 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.635197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:46.635197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:48:46.635197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:48:46.636079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c82e-58ee-4225-baae-67207b0fa84f admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.648132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 770/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:48:46.652492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:46.654056 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.688176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552d38-ce57-4e79-a0fd-15785b83401f admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:46.781059 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:46.781720 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.781997 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.782272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] PATH_INFO: `/v3/projects/ec5e3d65f31648e6b895c7a7553f0f9c/users/ceb6827682714a8c8c9758287d737963/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.804903 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5e3d65f31648e6b895c7a7553f0f9c, user_id=ceb6827682714a8c8c9758287d737963, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:46.805915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:46.805915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:48:46.805915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:48:46.807842 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cae47f-e731-47f9-bf81-3e2f99dc1183 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:46.831398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 731/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:48:46 2022] PUT /identity/v3/projects/ec5e3d65f31648e6b895c7a7553f0f9c/users/ceb6827682714a8c8c9758287d737963/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:46.843551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ae6f-aa60-48d6-b851-e8fec88e3302 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.843845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ae6f-aa60-48d6-b851-e8fec88e3302 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.844125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41ae6f-aa60-48d6-b851-e8fec88e3302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:46.901369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-ff41ae6f-aa60-48d6-b851-e8fec88e3302 None None] MFA Rules not processed for user `ceb6827682714a8c8c9758287d737963`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:46.902509 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-ff41ae6f-aa60-48d6-b851-e8fec88e3302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:46.984927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 771/1502] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:46.998625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:46.998912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:46.999193 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.000582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 732/1503] 10.222.0.59 () {54 vars in 964 bytes} [Mon Jul 25 22:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:47.005566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f49fa-efae-4862-888b-65066bb331ab None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:47.005857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f49fa-efae-4862-888b-65066bb331ab None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:47.006135 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f49fa-efae-4862-888b-65066bb331ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.037965 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:47.082630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-725f49fa-efae-4862-888b-65066bb331ab None None] MFA Rules not processed for user `bfd0c9fabb1040cd9055b16f3504301f`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:47.083847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-725f49fa-efae-4862-888b-65066bb331ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:47.160265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 772/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Mon Jul 25 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:47.168582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:47.170119 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:47.219806 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:47.275019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19517c7a-9f94-47ae-b3d8-9aa2f55c0dfa None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:47.347541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd0c9fabb1040cd9055b16f3504301f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:47.348158 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:47.348473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:47.348745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.350369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:47.446998 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:47.448381 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:47.451817 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:47.467437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 733/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:48:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:48:47.514879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74d73-954e-4dc2-8435-63b66ed8b887 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:47.515174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74d73-954e-4dc2-8435-63b66ed8b887 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:47.515460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb74d73-954e-4dc2-8435-63b66ed8b887 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.516797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 773/1506] 10.222.0.59 () {52 vars in 830 bytes} [Mon Jul 25 22:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:48:47.520349 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:47.521564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:47.621897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb9a57-a097-4bed-bb7d-8847159513fa service cinder] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:47.715693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:47.716365 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:47.716594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:47.716871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] PATH_INFO: `/v3/users/ceb6827682714a8c8c9758287d737963` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.728928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb6827682714a8c8c9758287d737963)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:47.729949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:47.729949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:48:47.729949 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:48:47.731160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:47.740563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:47.792544 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb6827682714a8c8c9758287d737963'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:47.804551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb6827682714a8c8c9758287d737963'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:47.813323 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb6827682714a8c8c9758287d737963'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:47.813780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb6827682714a8c8c9758287d737963'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:47.814282 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb6827682714a8c8c9758287d737963'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:47.838321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 734/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Jul 25 22:48:47 2022] DELETE /identity/v3/users/ceb6827682714a8c8c9758287d737963 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:47.842818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:47.843308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:47.843430 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:47.900436 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:48:47.901648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:47.977686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:47.990382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 774/1508] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:48:48.000440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:48.001960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:48.102918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04b1c4-c209-4c43-bcc3-04e96c61b7f8 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:48.156757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:48.177607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:48.178228 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.178508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.179302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.180939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:48.290350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:48.291777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c31c8-abae-4337-b610-4af16589a3dc service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:48.310692 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 735/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:48:48.632080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:48:48.633376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:48:48.644631 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe5914-5053-4f7d-8881-e73132cc7e11 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:48:48.741868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:48:48.742516 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:48:48.742797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:48:48.743074 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] PATH_INFO: `/v3/projects/ec5e3d65f31648e6b895c7a7553f0f9c` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:48:48.752839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5e3d65f31648e6b895c7a7553f0f9c)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:48:48.753939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:48:48.753939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:48:48.753939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:48:48.755132 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:48:48.812557 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5e3d65f31648e6b895c7a7553f0f9c', 'request_id': 'req-39c75da4-e194-4f75-a8e5-caf109b7e4eb'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:48.825371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5e3d65f31648e6b895c7a7553f0f9c', 'request_id': 'req-39c75da4-e194-4f75-a8e5-caf109b7e4eb'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:48.831923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5e3d65f31648e6b895c7a7553f0f9c', 'request_id': 'req-39c75da4-e194-4f75-a8e5-caf109b7e4eb'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:48.858235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] The token cache is being invalidate because project ec5e3d65f31648e6b895c7a7553f0f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87030) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:48:48.858869 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:48.858966 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-39c75da4-e194-4f75-a8e5-caf109b7e4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:48:48.860352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 775/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Jul 25 22:48:48 2022] DELETE /identity/v3/projects/ec5e3d65f31648e6b895c7a7553f0f9c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:48:58.308450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=62 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:48:58.856199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:08.199923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.200485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.200485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.202114 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 736/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:08.206832 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f4-e18c-4e1b-ab1c-880bb0ab57bd None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.207237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f4-e18c-4e1b-ab1c-880bb0ab57bd None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.207383 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b807f0f4-e18c-4e1b-ab1c-880bb0ab57bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.291941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-b807f0f4-e18c-4e1b-ab1c-880bb0ab57bd None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:08.293210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b807f0f4-e18c-4e1b-ab1c-880bb0ab57bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:08.394943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 776/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:08.547380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:08.549506 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:08.668045 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5c5a7b-f686-491d-b9d6-de2c6ca3ef36 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:08.673449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:08.674067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:08.674353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:08.674630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:08.683255 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:08.684880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553b3ea4-0855-40c3-90b3-8886a46893f1 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:08.694264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 737/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:09.530741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3514-c4ad-4e74-88dd-5827f847e6e9 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:09.531308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3514-c4ad-4e74-88dd-5827f847e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:09.531308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c3514-c4ad-4e74-88dd-5827f847e6e9 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:09.532695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 777/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:09.537530 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41279-56fb-4dbb-ae69-c7cac086dcd1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:09.537962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41279-56fb-4dbb-ae69-c7cac086dcd1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:09.538075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c41279-56fb-4dbb-ae69-c7cac086dcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:09.557603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-53c41279-56fb-4dbb-ae69-c7cac086dcd1 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:09.558777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-53c41279-56fb-4dbb-ae69-c7cac086dcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:09.566424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 738/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:09.717208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c3514-c4ad-4e74-88dd-5827f847e6e9 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:09.731414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c3514-c4ad-4e74-88dd-5827f847e6e9 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:09.737894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:09.738501 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:09.738783 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:09.739057 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:09.747511 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:09.749131 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85341648-cb13-4adc-8dd5-769a4afd8398 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:09.758366 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 778/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:12.452187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab21a-a0e5-46ba-b457-04aa94865a6c None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.452871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab21a-a0e5-46ba-b457-04aa94865a6c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.452871 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceab21a-a0e5-46ba-b457-04aa94865a6c None None] PATH_INFO: `/v3` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.454569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 739/1517] 10.222.0.42 () {54 vars in 925 bytes} [Mon Jul 25 22:50:12 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 22:50:12.494918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2265c-0db5-4659-a064-8c5afab745d0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:12.495473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2265c-0db5-4659-a064-8c5afab745d0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:12.495473 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2265c-0db5-4659-a064-8c5afab745d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:12.558036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-cdb2265c-0db5-4659-a064-8c5afab745d0 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:12.559239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-cdb2265c-0db5-4659-a064-8c5afab745d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:12.579847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:12.636489 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 779/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jul 25 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:16.706604 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22701b-0305-4af3-8f50-bc4ddfa2b76c None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.707162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22701b-0305-4af3-8f50-bc4ddfa2b76c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.707162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22701b-0305-4af3-8f50-bc4ddfa2b76c None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.708523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 740/1519] 10.222.0.59 () {54 vars in 961 bytes} [Mon Jul 25 22:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:16.713450 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656186e-c34e-4d2a-a7ba-e52507fadd6c None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.713862 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656186e-c34e-4d2a-a7ba-e52507fadd6c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.714808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656186e-c34e-4d2a-a7ba-e52507fadd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.735888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-7656186e-c34e-4d2a-a7ba-e52507fadd6c None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:16.737129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-7656186e-c34e-4d2a-a7ba-e52507fadd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:16.745846 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 780/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Mon Jul 25 22:50:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:16.753233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22701b-0305-4af3-8f50-bc4ddfa2b76c None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:16.766634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22701b-0305-4af3-8f50-bc4ddfa2b76c None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:16.771571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:16.772166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:16.772471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:16.772743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:16.781448 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:16.783017 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124550-0756-41d2-b7d2-d90d8e5a7aca service placement] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:16.792515 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 741/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:20.976327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e573d-a712-4028-9011-909bfbc1184c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:20.976900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e573d-a712-4028-9011-909bfbc1184c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:20.976900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e573d-a712-4028-9011-909bfbc1184c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:20.978279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 781/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:20.983695 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f929-239e-4a71-ada8-2f16a05dd67a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:20.984136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f929-239e-4a71-ada8-2f16a05dd67a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:20.984242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f929-239e-4a71-ada8-2f16a05dd67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.003462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-9c33f929-239e-4a71-ada8-2f16a05dd67a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:21.004681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9c33f929-239e-4a71-ada8-2f16a05dd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:21.012717 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 742/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:21.166348 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e573d-a712-4028-9011-909bfbc1184c None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:21.180789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e573d-a712-4028-9011-909bfbc1184c None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:21.186127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:21.186734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:21.187014 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:21.187290 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:21.195160 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:21.196750 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab1a0-92f8-43e9-9c79-25a7c2c5e8f3 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:21.206648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 782/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:22.017451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63658d-ae41-49a5-b46f-f30870be0e30 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.017893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63658d-ae41-49a5-b46f-f30870be0e30 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.018011 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63658d-ae41-49a5-b46f-f30870be0e30 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.019424 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 743/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 22:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:22.024050 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fa36-d719-4689-ab5c-305a30e740c2 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.024455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fa36-d719-4689-ab5c-305a30e740c2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.024642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657fa36-d719-4689-ab5c-305a30e740c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.043980 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d657fa36-d719-4689-ab5c-305a30e740c2 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:22.045202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d657fa36-d719-4689-ab5c-305a30e740c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:22.052952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 783/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 22:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:22.203650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63658d-ae41-49a5-b46f-f30870be0e30 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:22.217705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63658d-ae41-49a5-b46f-f30870be0e30 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:22.223026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:22.223625 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:22.223904 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:22.224176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:22.232071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:22.233899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f09b9-978a-49c0-a802-5e73134fd1dc service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:22.243025 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 744/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:26.178609 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.179154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.179154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.180561 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 784/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:26.185722 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe389e2-1ff7-41bd-8c03-36b350bb9688 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.186165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe389e2-1ff7-41bd-8c03-36b350bb9688 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.186280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe389e2-1ff7-41bd-8c03-36b350bb9688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.205676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-cfe389e2-1ff7-41bd-8c03-36b350bb9688 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:26.206877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-cfe389e2-1ff7-41bd-8c03-36b350bb9688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:26.215261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 745/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:26.287154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:26.288890 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:26.366280 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db8a92-1e5d-4e56-b08e-611b9b85dad7 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:26.369819 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:26.370459 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:26.370741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:26.371018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:26.379843 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:26.381287 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d753ea9-a784-4ad8-b8fe-d5bae25b09b0 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:26.391190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 785/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:28.369688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0076e-f2f1-4c42-b9b4-25ad9e370608 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:28.370729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0076e-f2f1-4c42-b9b4-25ad9e370608 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:28.370823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0076e-f2f1-4c42-b9b4-25ad9e370608 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:28.372130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 746/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:28.377488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd21b-47dc-46e4-9a17-d90968a26d56 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:28.377936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd21b-47dc-46e4-9a17-d90968a26d56 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:28.378037 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfd21b-47dc-46e4-9a17-d90968a26d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:28.397612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-38dfd21b-47dc-46e4-9a17-d90968a26d56 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:28.398813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-38dfd21b-47dc-46e4-9a17-d90968a26d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:28.406620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 786/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:28.442219 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0076e-f2f1-4c42-b9b4-25ad9e370608 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:28.453735 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0076e-f2f1-4c42-b9b4-25ad9e370608 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:28.457236 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:28.457863 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:28.458126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:28.458400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:28.467175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:28.468648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77cce5e-4959-43ee-bd36-1c41199de008 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:28.477891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 747/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:31.961727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:31.962313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:31.962313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:31.964153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 787/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:31.969539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d7e-35b4-4abd-8a9a-e3ececc03d4a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:31.969952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d7e-35b4-4abd-8a9a-e3ececc03d4a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:31.970096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9385d7e-35b4-4abd-8a9a-e3ececc03d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:31.994567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-a9385d7e-35b4-4abd-8a9a-e3ececc03d4a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:31.995801 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a9385d7e-35b4-4abd-8a9a-e3ececc03d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:32.003789 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 748/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:32.315417 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:32.317149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:32.381536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:32.395632 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164066e-4226-45fa-a5c9-daeaa345a9c4 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:32.399169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd0c9fabb1040cd9055b16f3504301f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:32.399787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:32.400070 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:32.400435 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:32.409875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:32.411295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e04599-1636-42a7-a76b-84ebb9177927 service cinder] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:32.420553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 788/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:34.432770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:34.433305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:34.433305 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:34.434729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 749/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 22:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:50:34.439921 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9eddc-973a-466e-bd0d-26082b722d8f None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:34.440342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9eddc-973a-466e-bd0d-26082b722d8f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:34.440497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9eddc-973a-466e-bd0d-26082b722d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:34.459942 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-78a9eddc-973a-466e-bd0d-26082b722d8f None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:50:34.461174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-78a9eddc-973a-466e-bd0d-26082b722d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:34.469394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 789/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 22:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:50:34.775957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:50:34.778212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:50:34.790870 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e286a-dad1-4028-a7d6-1b9da35a156a None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:50:34.794370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfd0c9fabb1040cd9055b16f3504301f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:50:34.794971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:50:34.795249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:50:34.795521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:50:34.804126 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:50:34.805567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9d59d-db03-445c-9e64-2d1335622289 service cinder] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:50:34.814763 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 750/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:50:44.455190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=11 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:50:44.810777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=89 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:58.838250 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc670f-c05b-4d81-9f55-a5d21b51aa06 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.838891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc670f-c05b-4d81-9f55-a5d21b51aa06 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.838891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc670f-c05b-4d81-9f55-a5d21b51aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.851089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e60c-1f1e-42a6-aec3-03004de95376 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.851600 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e60c-1f1e-42a6-aec3-03004de95376 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.851702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e60c-1f1e-42a6-aec3-03004de95376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.857914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-6bfc670f-c05b-4d81-9f55-a5d21b51aa06 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:58.859109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-6bfc670f-c05b-4d81-9f55-a5d21b51aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.867177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 790/1540] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:58.871668 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-8956e60c-1f1e-42a6-aec3-03004de95376 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:58.872888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-8956e60c-1f1e-42a6-aec3-03004de95376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.875710 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.875994 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.876272 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.880834 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 751/1541] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:58.889714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.890001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.890312 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.895875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:58.897088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.904971 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 791/1542] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:58.909357 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.909756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:58.910996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:58.918350 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90b0fa-917e-47f6-a90d-b4f125ee1ad1 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.918960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 752/1543] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:51:58.922887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.923327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.923490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.923769 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.924039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] PATH_INFO: `/v3/domains` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.924749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87030) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:51:58.925049 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.926621 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:58.932225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bf932-f28d-4ff1-8720-a55866cd07f8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.937837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.938432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.938715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.938815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 792/1544] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Jul 25 22:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:51:58.938995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] PATH_INFO: `/v3/domains` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.939683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 22:51:58.939990 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.941039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:51:58.941039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:51:58.941039 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:51:58.941923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:58.946440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.959137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 753/1545] 10.222.0.59 () {58 vars in 1153 bytes} [Mon Jul 25 22:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 22:51:58.959315 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0877e-2a6b-4226-a4fa-03c9051edb3f admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.962130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:58.963256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.963885 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.964192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.964496 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.965156 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.966162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:51:58.966162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:51:58.966162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:51:58.967345 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:58.971800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd8f42-7aac-4670-b0f5-c021fc94620f admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:58.976799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:58.977394 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:58.977679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:58.977956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:58.978623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:58.980646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.006563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 793/1546] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:51:59.009814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 754/1547] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Jul 25 22:51:58 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:51:59.013237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.014055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.074977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a19d5-9592-4dd7-8b22-5efad7cd267e admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.076267 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a271f-78d8-4727-8048-845c8be9a4d4 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.079643 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.080392 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.080573 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.080845 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.081492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.081611 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.082134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.082395 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.082672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.083337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.083451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.084384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:51:59.084384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:51:59.084384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:51:59.085588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.108319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 794/1548] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:51:59 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:51:59.108500 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 755/1549] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:51:59 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 22:51:59.109780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.110872 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.119377 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c35577-3235-41f6-a8f4-212378dbf81a admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.121413 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ceea2d-3fea-446f-8518-be7e672ba67c admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.124686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.125306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.125594 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.125875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.126306 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.126814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.126917 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.127169 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.127440 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.128262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.128470 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.129891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.140525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 756/1550] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:51:59.144231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.148597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 795/1551] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:51:59.149614 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.153900 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264759dd-1bcb-474b-9571-a4db0e6a9057 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.158592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.159217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.159499 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.159748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ec919-aaca-4a95-adf4-c8e56c3c9300 admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.159850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.160620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.162205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.164375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.164964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.165246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.165521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.166202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.168372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.174385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 757/1552] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:51:59.178684 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 796/1553] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:51:59.178849 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.182569 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.189003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dce88a-527b-4005-bc2a-dae23a313d57 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.192463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329c7da-7370-46fa-86c3-965d69117b92 admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.193766 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.194425 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.194741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.195020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] PATH_INFO: `/v3/projects/5e48ea2aa437431caccfb50c71e3bab4/users/9911e8bb7a254ec7b0fe19d36ebd9b98/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.197040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.197681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.197964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.198242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] PATH_INFO: `/v3/projects/6df2ab7798674d6e9031bac10f0e7f77/users/1f77b6499dde4cc78fc4d4b5ab43dc47/roles/14635753bbaa46bfb5475d51ad0b91a5` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.209953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e48ea2aa437431caccfb50c71e3bab4, user_id=9911e8bb7a254ec7b0fe19d36ebd9b98, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.212756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ccd95-4e3e-4133-859c-0caa938c133a admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.212947 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6df2ab7798674d6e9031bac10f0e7f77, user_id=1f77b6499dde4cc78fc4d4b5ab43dc47, role_id=14635753bbaa46bfb5475d51ad0b91a5)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.214038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:51:59.214038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:51:59.214038 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:51:59.215972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ce923-8b9c-41f4-b523-389319f1198e admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.226067 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 758/1554] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:51:59 2022] PUT /identity/v3/projects/5e48ea2aa437431caccfb50c71e3bab4/users/9911e8bb7a254ec7b0fe19d36ebd9b98/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:51:59.228655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 797/1555] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:51:59 2022] PUT /identity/v3/projects/6df2ab7798674d6e9031bac10f0e7f77/users/1f77b6499dde4cc78fc4d4b5ab43dc47/roles/14635753bbaa46bfb5475d51ad0b91a5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:51:59.234008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.234162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.234300 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.234405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.234572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.234675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.253494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:59.254702 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:59.258751 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] MFA Rules not processed for user `f76f4c331aa04a1a86326998b6795006`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:51:59.259934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:51:59.302240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:59.302893 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:51:59.316810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 759/1556] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:59.323177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 798/1557] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:51:59.327085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.332064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:51:59.381147 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c258-147e-407d-a7c4-4e1f3f3c9f5c None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.385167 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.385780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.386018 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db26c5-23d9-4359-a5c5-dc78c38fc30a None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:51:59.386128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.386336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.389737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:51:59.390351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:51:59.390666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:51:59.390946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:51:59.395292 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.396787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c84ef-6bb0-4ec7-b0d9-bfced8edfcdc service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.400844 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:51:59.402294 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:51:59.406291 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 760/1558] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:51:59.412076 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 799/1559] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:52:05.092732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.093205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.093374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.155369 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] MFA Rules not processed for user `1f77b6499dde4cc78fc4d4b5ab43dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:05.159036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:05.280320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 761/1560] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:05.285008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.296391 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946922c-b688-4927-ad92-0668258fcf49 service neutron] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.304642 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.305341 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.305630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.305906 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.306581 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.308589 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dd8d3-b1e6-4fa7-9bd3-db3b42a96c4c admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.364331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 800/1561] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:52:05.366873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.386880 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24057d-d4c1-429f-9bcd-2bbd682a44f8 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.490086 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.490571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.490888 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.517064 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.518177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.518809 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.519444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] PATH_INFO: `/v3/users` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.520607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.522962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.551262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:05.553303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:05.567096 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 762/1562] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:52:05.571162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.588152 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86eed0a-11b0-4ac7-86b8-395de8fe9a51 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.604989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.606077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.608088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.608773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.610346 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.613645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.631776 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 763/1563] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:52:05.633043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.643529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c451ce-095d-4c82-a73c-14f5be69a7b8 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.650747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.650747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.650747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.650747 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] PATH_INFO: `/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e/users/27fa8761e2a34defa1ffb1f4371fada8/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.659896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 801/1564] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:05.665333 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.668956 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:05.683715 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d43561-dfc2-4db2-b3b5-784a41f7ebcc None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.688687 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.689034 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dbd37d6bba483a9c9cfc8c11231a8e, user_id=27fa8761e2a34defa1ffb1f4371fada8, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.689320 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.689649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.690370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] PATH_INFO: `/v3/projects` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.690566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.691718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.692474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.712108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 764/1565] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:52:05 2022] PUT /identity/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e/users/27fa8761e2a34defa1ffb1f4371fada8/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:52:05.718079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.735674 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 802/1566] 10.222.0.59 () {60 vars in 1153 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:52:05.738151 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.790610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:05.802493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a8bd4-714c-48f7-a50a-1156b1b21590 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.822204 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3643c-3013-48a6-914d-7e44cb67713d admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.828770 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.830087 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.830374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.831285 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] PATH_INFO: `/v3/users` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.831523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.834141 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.865080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 803/1567] 10.222.0.59 () {60 vars in 1144 bytes} [Mon Jul 25 22:52:05 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 22:52:05.869265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.873607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.874252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.874536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.874811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.875519 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.877185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.881245 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9093a0-1393-4818-b18d-7a2771795af5 admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.887577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.888606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.888606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.888941 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] PATH_INFO: `/v3/roles` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.889651 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.890418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 765/1568] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:52:05.891546 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.894538 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.907827 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef6846-616e-43d6-b20b-223ff163fdf4 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.910155 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 804/1569] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 22:52:05.911270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:05.915220 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.915922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] REQUEST_METHOD: `PUT` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.916207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.916638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] PATH_INFO: `/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e/users/27fa8761e2a34defa1ffb1f4371fada8/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.919593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dbd37d6bba483a9c9cfc8c11231a8e, user_id=27fa8761e2a34defa1ffb1f4371fada8, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.922474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7013473-1953-40d2-85dc-c8ef51f0821e admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:05.922800 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.927825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:05.928926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:05.929108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:05.929390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] PATH_INFO: `/v3/projects/42846462b7cb48aa949f28a983359536/users/6166b1bb11274930bdb0640099611fa9/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:05.936066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 766/1570] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:52:05 2022] PUT /identity/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e/users/27fa8761e2a34defa1ffb1f4371fada8/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:52:05.950352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42846462b7cb48aa949f28a983359536, user_id=6166b1bb11274930bdb0640099611fa9, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:05.953936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:05.975627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 805/1571] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:52:05 2022] PUT /identity/v3/projects/42846462b7cb48aa949f28a983359536/users/6166b1bb11274930bdb0640099611fa9/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:52:05.976696 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:06.079992 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d9338-261a-48df-8ddd-fec728569692 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:06.125384 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:06.191231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:06.191745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:06.191964 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:06.192235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] PATH_INFO: `/v3/roles` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:06.193023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:06.194943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e448c-32a7-48a2-8440-ecfe8a5bd975 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:06.208590 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 767/1572] 10.222.0.59 () {58 vars in 1122 bytes} [Mon Jul 25 22:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 22:52:06.213234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:06.226568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecbda1-2e67-4e92-87d6-91a899db5b2b admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:06.236753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:06.237474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] REQUEST_METHOD: `PUT` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:06.237736 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:06.238010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] PATH_INFO: `/v3/projects/42846462b7cb48aa949f28a983359536/users/6166b1bb11274930bdb0640099611fa9/roles/e3f77a14908d48e99043f557a465098a` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:06.243558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42846462b7cb48aa949f28a983359536, user_id=6166b1bb11274930bdb0640099611fa9, role_id=e3f77a14908d48e99043f557a465098a)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:06.247036 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:06.264335 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 806/1573] 10.222.0.59 () {60 vars in 1483 bytes} [Mon Jul 25 22:52:06 2022] PUT /identity/v3/projects/42846462b7cb48aa949f28a983359536/users/6166b1bb11274930bdb0640099611fa9/roles/e3f77a14908d48e99043f557a465098a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:52:11.379451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309289b4-714b-4156-a4d1-eb4e3ecc3598 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:11.379901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309289b4-714b-4156-a4d1-eb4e3ecc3598 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:11.380003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309289b4-714b-4156-a4d1-eb4e3ecc3598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:11.427733 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-309289b4-714b-4156-a4d1-eb4e3ecc3598 None None] MFA Rules not processed for user `27fa8761e2a34defa1ffb1f4371fada8`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:11.429210 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-309289b4-714b-4156-a4d1-eb4e3ecc3598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:11.569603 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 768/1574] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:52:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:11.594901 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:11.602958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:11.724984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20a85a-0f77-49ea-af22-4f39499d4b33 admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:11.730745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117a0317f7994b59a6a23786c9155399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:11.731376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:11.732097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:11.732097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:11.845227 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:11.847166 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ea42a-5547-40d4-8acc-d413138a1a31 service glance] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:11.867927 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 807/1575] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:12.277408 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:12.278265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:12.278265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:12.386526 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:12.388653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:12.389079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:12.422622 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:12.424784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:12.429967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:12.442706 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] MFA Rules not processed for user `6166b1bb11274930bdb0640099611fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:12.450583 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:12.546363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 769/1576] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:12.625718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 808/1577] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:52:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:12.638686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:12.650035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7aa751-c569-4ca5-bd20-2bebd4e45d41 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:12.655027 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117a0317f7994b59a6a23786c9155399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:12.655910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:12.656277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:12.656653 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:12.671493 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:12.752968 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:12.754504 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:12.774930 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:12.776666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ca0a1c-1e29-484c-9398-aad8eaf3c7f7 service glance] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:12.787741 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 770/1578] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:12.917196 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e29c0-53b5-42fc-81a9-b3cd708232c0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:12.923172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:12.923321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:12.923535 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:12.923808 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:12.934149 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:12.935773 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:12.945681 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 809/1579] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:52:14.617975 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28a8-c604-4d0f-9d2f-f7f0a82a4b17 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:14.618495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28a8-c604-4d0f-9d2f-f7f0a82a4b17 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:14.618756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad28a8-c604-4d0f-9d2f-f7f0a82a4b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:14.667432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b8ad28a8-c604-4d0f-9d2f-f7f0a82a4b17 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:14.668703 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b8ad28a8-c604-4d0f-9d2f-f7f0a82a4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:14.691024 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 771/1580] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:14.714368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:14.743564 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d33214-e94b-4e01-8457-6e1c70374cdb service swift] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:14.751712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:14.754183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:14.754183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:14.754649 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:14.776989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:14.778912 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db6702-4b08-4276-b493-47b7ef8765c0 service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:14.812276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 810/1581] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:52:23.715748 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98c22-001e-4973-8022-20079044cf8a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:23.716217 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98c22-001e-4973-8022-20079044cf8a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:23.716336 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f98c22-001e-4973-8022-20079044cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:23.739838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-57f98c22-001e-4973-8022-20079044cf8a None None] MFA Rules not processed for user `1f77b6499dde4cc78fc4d4b5ab43dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:23.741008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-57f98c22-001e-4973-8022-20079044cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:23.752648 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 772/1582] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:52:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:24.057270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afb95-7148-4e86-ac08-1f89555c2ab5 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.058099 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afb95-7148-4e86-ac08-1f89555c2ab5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.058537 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0afb95-7148-4e86-ac08-1f89555c2ab5 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.060787 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 811/1583] 10.222.0.59 () {54 vars in 962 bytes} [Mon Jul 25 22:52:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:24.067048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd503-4db1-42f1-88c0-1a61ef3f93da None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.067411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd503-4db1-42f1-88c0-1a61ef3f93da None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.067771 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bd503-4db1-42f1-88c0-1a61ef3f93da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.111191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-db8bd503-4db1-42f1-88c0-1a61ef3f93da None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:24.115372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-db8bd503-4db1-42f1-88c0-1a61ef3f93da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.213908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 773/1584] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Jul 25 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:24.219308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.219852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.220153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.221562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 812/1585] 10.222.0.59 () {54 vars in 912 bytes} [Mon Jul 25 22:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:24.227075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da317b0-a47e-4e15-a526-69a19c6a375a None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.227363 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da317b0-a47e-4e15-a526-69a19c6a375a None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.227639 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da317b0-a47e-4e15-a526-69a19c6a375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.251208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6da317b0-a47e-4e15-a526-69a19c6a375a None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:24.252375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6da317b0-a47e-4e15-a526-69a19c6a375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.262295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 774/1586] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:24.274543 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:24.277209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.291232 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cccaed-397f-4ec8-917a-298b13bdc6e8 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:24.295835 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '117a0317f7994b59a6a23786c9155399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:24.296630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.297111 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.297508 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.315115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:24.317136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a44e4f1-f9d0-47f9-a727-cdbb2ddd5ae4 service glance] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:24.331879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 813/1587] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:24.668678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.669191 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.669640 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.671140 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 775/1588] 10.222.0.59 () {54 vars in 912 bytes} [Mon Jul 25 22:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:24.676726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da95b0-bcba-4e54-8889-f1049233c351 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.677185 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da95b0-bcba-4e54-8889-f1049233c351 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.677539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da95b0-bcba-4e54-8889-f1049233c351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.720449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-33da95b0-bcba-4e54-8889-f1049233c351 None None] MFA Rules not processed for user `9fc7adc92a5b41bea6a0929eadc50689`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:24.721659 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-33da95b0-bcba-4e54-8889-f1049233c351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.741274 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=100 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:24.772209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 814/1589] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:24.784001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:24.785628 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:24.798437 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e838f-863a-46cd-b046-e0abd2885852 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:24.801952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:24.802560 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:24.802839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:24.803113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:24.809954 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:24.811375 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd97ce-813a-41c0-9177-6ad6ea333a09 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:24.819022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 776/1590] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:25.204317 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bf8-4643-40ca-941b-1cc26dd579a5 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.204908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bf8-4643-40ca-941b-1cc26dd579a5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.204908 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88051bf8-4643-40ca-941b-1cc26dd579a5 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.206261 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 815/1591] 10.222.0.59 () {54 vars in 962 bytes} [Mon Jul 25 22:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:25.212176 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38a3b-3c8f-401a-8b52-16e2cb4f2794 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.212497 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38a3b-3c8f-401a-8b52-16e2cb4f2794 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.212799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b38a3b-3c8f-401a-8b52-16e2cb4f2794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.227328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564ea5-3d6f-4b48-865b-41a00f9a974c None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.227693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564ea5-3d6f-4b48-865b-41a00f9a974c None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.228080 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564ea5-3d6f-4b48-865b-41a00f9a974c None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.229597 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 816/1592] 10.222.0.59 () {54 vars in 961 bytes} [Mon Jul 25 22:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:52:25.233860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b0b38a3b-3c8f-401a-8b52-16e2cb4f2794 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:25.235066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b0b38a3b-3c8f-401a-8b52-16e2cb4f2794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:25.236587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.236993 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.237368 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.245298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 777/1593] 10.222.0.59 () {58 vars in 1059 bytes} [Mon Jul 25 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:25.251403 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb700-d0bd-44bc-b260-e4f49facd00b None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.251758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb700-d0bd-44bc-b260-e4f49facd00b None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.252100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcb700-d0bd-44bc-b260-e4f49facd00b None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.253974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 778/1594] 10.222.0.59 () {54 vars in 912 bytes} [Mon Jul 25 22:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 22:52:25.258855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.259134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.259414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.262585 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:25.263976 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:25.282229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:25.283780 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:25.296089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 779/1595] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:25.310646 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:25.320610 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1eba-a8a1-4a29-95f9-03a41f3e06c1 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:25.325277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:25.325907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.326190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.326466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.337513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:25.338972 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175833d-8664-4a71-a8e8-7dee2297fc4b service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:25.350623 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 780/1596] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:25.354308 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 817/1597] 10.222.0.59 () {58 vars in 1058 bytes} [Mon Jul 25 22:52:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:25.362877 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:25.373664 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af19bc3-f61a-4098-8833-15a5a38f1859 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:25.379066 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:25.379784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:25.380069 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:25.380380 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:25.382172 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:25.394989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:25.396644 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:25.407310 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 818/1598] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:27.182896 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ed9c-a282-4ad0-bbd5-3fee3a405062 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:27.183355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ed9c-a282-4ad0-bbd5-3fee3a405062 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:27.183451 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1ed9c-a282-4ad0-bbd5-3fee3a405062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:27.203671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-eac1ed9c-a282-4ad0-bbd5-3fee3a405062 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:27.204931 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-eac1ed9c-a282-4ad0-bbd5-3fee3a405062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:27.212587 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 781/1599] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:52:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:52:27.228579 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:27.240989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa5791-0c7d-4662-b271-80734009028e service placement] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:27.246001 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:27.246830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:27.247113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:27.247580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:27.256231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:27.257839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:27.266853 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 819/1600] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:52:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:52:35.198441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d66f-d649-4445-b8c3-2e72e614b370 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.198948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d66f-d649-4445-b8c3-2e72e614b370 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.199223 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3d66f-d649-4445-b8c3-2e72e614b370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.220165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-abd3d66f-d649-4445-b8c3-2e72e614b370 None None] MFA Rules not processed for user `9fc7adc92a5b41bea6a0929eadc50689`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:35.221536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-abd3d66f-d649-4445-b8c3-2e72e614b370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:35.228351 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 782/1601] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Jul 25 22:52:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:35.242026 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:35.251231 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704be3ce-0eff-4036-a9ef-4f8fcc02545a service swift] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:35.254799 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:35.255513 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:35.255791 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:35.256061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:35.264462 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:35.265887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b013e-0dee-4c64-bd8b-d761de74d09d service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:35.273857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 820/1602] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:36.083860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4f8d-5246-48c2-b42f-f75c81eda572 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:36.084130 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4f8d-5246-48c2-b42f-f75c81eda572 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:36.084460 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4f8d-5246-48c2-b42f-f75c81eda572 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:36.086071 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 783/1603] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:36.123958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8564-dfe6-4a22-ba1d-7a57e520397d None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:36.124246 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8564-dfe6-4a22-ba1d-7a57e520397d None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:36.127737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c8564-dfe6-4a22-ba1d-7a57e520397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:36.158048 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-994c8564-dfe6-4a22-ba1d-7a57e520397d None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:36.159352 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-994c8564-dfe6-4a22-ba1d-7a57e520397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:36.177439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 821/1604] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:52:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:36.198762 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4f8d-5246-48c2-b42f-f75c81eda572 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:36.215431 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4f8d-5246-48c2-b42f-f75c81eda572 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:36.220833 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:36.221533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:36.221818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:36.222115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:36.231471 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:36.233105 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bfa4c-26ae-478d-8900-8f0a66328037 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:36.246523 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 784/1605] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:42.869815 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61805e-b636-49d1-932c-e1dfa2dd63c5 None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.870412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61805e-b636-49d1-932c-e1dfa2dd63c5 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.870412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61805e-b636-49d1-932c-e1dfa2dd63c5 None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.871922 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 822/1606] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:52:42.880923 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.881371 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.881485 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.891638 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=99 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:42.914212 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:52:42.915472 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:52:42.924981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 785/1607] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:52:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:52:42.940094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61805e-b636-49d1-932c-e1dfa2dd63c5 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:52:42.959088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61805e-b636-49d1-932c-e1dfa2dd63c5 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:52:42.964916 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:52:42.966423 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:52:42.966627 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:52:42.966981 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:52:42.976044 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:52:42.977670 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652256a0-bfa2-46ae-8767-ee4e87afb3a3 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:52:42.987795 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 823/1608] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:52:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:52:52.900593 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=2 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:52:52.983618 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=67 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:00.855453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:53:00.864562 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03abbcc-a5c1-4fde-be87-251843faba00 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:53:00.868068 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:53:00.868709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:00.868995 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:00.869269 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:00.878407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:53:00.879860 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adad24-dbbf-42b4-afb0-2842e70967b1 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:53:00.889019 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 786/1609] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:53:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:53:08.307373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a28e4-028d-42c4-a8d4-5daadba2dcbf None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:08.307867 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a28e4-028d-42c4-a8d4-5daadba2dcbf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:08.307960 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a28e4-028d-42c4-a8d4-5daadba2dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:08.327199 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a05a28e4-028d-42c4-a8d4-5daadba2dcbf None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:08.328439 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a05a28e4-028d-42c4-a8d4-5daadba2dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:08.335240 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 824/1610] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:53:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:53:10.885021 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=6 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:18.322303 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:53:50.339293 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:53:50.339820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:53:50.339820 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:53:50.358277 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:53:50.359465 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:53:50.366270 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 787/1611] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:53:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:00.353601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:07.014847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07895-8331-459b-b2ff-310365738b60 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.015353 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07895-8331-459b-b2ff-310365738b60 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.015441 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b07895-8331-459b-b2ff-310365738b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.035679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-53b07895-8331-459b-b2ff-310365738b60 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:07.037260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-53b07895-8331-459b-b2ff-310365738b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:07.045331 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 825/1612] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:54:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:07.086529 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:07.097895 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167523f2-f921-4c1f-bdc1-9b8dca989a10 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:07.103397 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:07.103952 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:07.104233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:07.104541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:07.112525 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:07.114097 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f2948-c2dd-4c40-9468-31c02a0f41ab service swift] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:07.122469 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 788/1613] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:54:10.451932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:10.452453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:10.452549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:10.470818 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:10.472008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:10.479214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 826/1614] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:54:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:17.119301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=6 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:20.465830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=6 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:38.588728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6105d-713b-4ede-b8f0-f4801ac58f74 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.589298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6105d-713b-4ede-b8f0-f4801ac58f74 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.589298 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6105d-713b-4ede-b8f0-f4801ac58f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.610016 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-e2b6105d-713b-4ede-b8f0-f4801ac58f74 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:38.611237 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-e2b6105d-713b-4ede-b8f0-f4801ac58f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:38.618466 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 789/1615] 10.222.0.59 () {58 vars in 967 bytes} [Mon Jul 25 22:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:38.631137 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:38.643205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640d4a-f110-42e9-b8bf-3decb6c57f46 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:38.648225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:38.649852 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:38.650133 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:38.650407 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:38.659729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:38.661372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9144-4937-4186-a671-7a6ae2aae852 service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:38.670873 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 827/1616] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:54:48.604599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:48.667183 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=6 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:54:56.251243 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:56.251804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:56.251804 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:56.270225 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:56.271427 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:56.278190 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 790/1617] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:54:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:56.641108 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:56.641683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:56.641683 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:56.661705 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] MFA Rules not processed for user `9fc7adc92a5b41bea6a0929eadc50689`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:54:56.662910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:54:56.670157 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 828/1618] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:54:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:54:56.681175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:54:56.690727 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdafd99-f987-429c-9113-696c39723ac2 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:54:56.694229 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:54:56.695109 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:54:56.695390 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:54:56.695666 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:54:56.702868 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:54:56.704521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:54:56.712767 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 791/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:54:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:06.656665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:06.708857 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=9 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:13.011734 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:13.020100 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b0821-ff53-41fc-ad08-072e97386ed2 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:13.023830 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:13.024983 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:13.025260 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:13.025533 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:13.034252 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:13.035665 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b4678-d6bb-490d-bf10-910c27571377 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:13.045662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 829/1620] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:17.645249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:55:17.657743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0492d-1875-4cf1-adcc-97bfcc114979 service neutron] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:55:17.662859 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:55:17.663474 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:55:17.663758 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:55:17.664033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:55:17.673006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:55:17.674601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6447b-0afa-41bd-a0c1-9229ad426a83 service placement] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:55:17.684385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 792/1621] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:55:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:55:23.041540 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=6 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:55:27.680168 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=6 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:13.543807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cdf6-85db-4da6-b6f9-01fd6df4207f None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.544420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cdf6-85db-4da6-b6f9-01fd6df4207f None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.544520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332cdf6-85db-4da6-b6f9-01fd6df4207f None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.547162 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 830/1622] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:56:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:56:13.551555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57b79-b990-4a90-8f47-ec73c475e816 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.552083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57b79-b990-4a90-8f47-ec73c475e816 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.552083 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec57b79-b990-4a90-8f47-ec73c475e816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.589592 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-6ec57b79-b990-4a90-8f47-ec73c475e816 None None] MFA Rules not processed for user `0683955d11d0442cae5e9e4d4f973e10`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:13.590672 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-6ec57b79-b990-4a90-8f47-ec73c475e816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:13.613177 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 793/1623] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:56:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:13.629182 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cdf6-85db-4da6-b6f9-01fd6df4207f None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:13.653145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332cdf6-85db-4da6-b6f9-01fd6df4207f None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:13.660235 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:13.660498 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:13.660732 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:13.661008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:13.675453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:13.677090 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:13.690279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 831/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:56:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:56:21.207797 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21d5b-f884-4b37-b1ba-df9408822fd1 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.208262 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21d5b-f884-4b37-b1ba-df9408822fd1 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.208418 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c21d5b-f884-4b37-b1ba-df9408822fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.227118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-d8c21d5b-f884-4b37-b1ba-df9408822fd1 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:21.228340 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-d8c21d5b-f884-4b37-b1ba-df9408822fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:21.235455 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 794/1625] 10.222.0.59 () {58 vars in 967 bytes} [Mon Jul 25 22:56:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:21.280918 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:21.292409 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee04786-d347-4a47-b2fd-e5358656c5c7 service nova] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:21.297393 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:21.297999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.298281 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.298553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.306400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:21.308003 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:21.315838 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 832/1626] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:56:21.764601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2612-0d64-41ff-93d8-518341a110b9 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.764891 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2612-0d64-41ff-93d8-518341a110b9 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.765171 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2612-0d64-41ff-93d8-518341a110b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.785121 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-897b2612-0d64-41ff-93d8-518341a110b9 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:21.786344 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-897b2612-0d64-41ff-93d8-518341a110b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:21.793645 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 795/1627] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:56:21.805545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:21.816412 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d23a6-f9fb-4ab0-be06-42af552252bc service swift] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:21.821599 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:21.822743 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:21.823055 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:21.823332 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:21.831580 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:21.833187 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc989cd-121f-4858-b404-4c595cf9fb57 service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:21.841958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 833/1628] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:56:30.025161 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:30.025667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:30.025764 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:30.045376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] MFA Rules not processed for user `1f77b6499dde4cc78fc4d4b5ab43dc47`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:30.046566 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:30.053355 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 796/1629] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:31.839124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=18 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.859601 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.860192 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.860309 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.880987 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:56:32.882295 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:56:32.890079 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 834/1630] 10.222.0.59 () {58 vars in 1009 bytes} [Mon Jul 25 22:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:56:32.903154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:56:32.914907 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd63e-b4f8-4504-a7a9-9fea18574080 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:56:32.920591 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:56:32.921239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:56:32.921522 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:56:32.921796 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:56:32.930894 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:56:32.933327 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853e791-1730-4481-ad1e-a8274be27722 service swift] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:56:32.941935 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 797/1631] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 22:56:42.875866 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=3 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:42.938482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=18 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:12.154939 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:12.168447 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362a7a3-19ac-4363-b998-4044048a6a49 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:12.173784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:12.174399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:12.174679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:12.174955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:12.182551 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:12.184125 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:12.193077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 835/1632] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:15.706445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:15.706445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:15.706445 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:15.726259 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:57:15.727490 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:57:15.734630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 798/1633] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:57:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 22:57:22.188879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=6 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:24.664582 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:24.673539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f241c-280a-4c80-8c42-45d3ddd3a00b service nova] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:24.677088 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:24.677686 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:24.677962 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:24.678233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:24.688113 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:24.689545 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:24.700810 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 836/1634] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:25.720984 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=3 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:25.871899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:25.881139 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae91432-5f2b-4875-ada0-69a98704ac5e None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:25.884608 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:25.885264 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:25.885541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:25.885811 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:25.895532 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:25.896989 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:25.907697 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 799/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:26.395505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:57:26.406969 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142056a-99f4-4a7b-ac3b-91b335e9d285 service neutron] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:57:26.412467 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:57:26.413075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:57:26.413356 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:57:26.413630 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:57:26.421883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:57:26.423458 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:57:26.432173 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 837/1636] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:57:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:35.902909 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=6 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:36.428319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=12 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:14.096768 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:14.112396 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567fc69-7ac2-4653-b628-5b4adad095d4 service neutron] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:14.119761 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:14.120547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:14.121031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:14.121370 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:14.133405 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:14.134823 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8d71d-179a-4ec3-8fd0-f9a568ec2b34 service nova] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:14.150399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 800/1637] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 22:58:14.258006 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:14.270612 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d32b7-80a0-418a-9151-e6a42357d7ba service nova] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:14.292634 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:14.297406 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:14.298379 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:14.298957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:14.310256 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:14.312175 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:14.323128 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 838/1638] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:21.733959 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.734432 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.734541 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.753456 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] MFA Rules not processed for user `d0fd5b7fad8e4578850502f9cacad2a3`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:21.754671 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:21.761982 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 801/1639] 10.222.0.59 () {58 vars in 967 bytes} [Mon Jul 25 22:58:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:21.804825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:21.817924 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3238f5-f613-4369-863d-3ecd9b77ea20 service neutron] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:21.823208 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d2a9820c2314fd8acbf6739408980af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:21.823825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:21.824106 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:21.824410 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:21.833023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:21.834584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b476cff-9b30-4a5c-8a95-530e76681115 service swift] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:21.843091 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 839/1640] 10.222.0.59 () {60 vars in 1384 bytes} [Mon Jul 25 22:58:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 22:58:22.199234 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:22.213633 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515021b-84b8-4e54-aa56-00cac7fa59e0 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:22.217230 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:22.217840 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:22.218145 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:22.218414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:22.277089 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:22.278521 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fae825-4c2c-495b-a023-cee5b38617ce service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:22.287974 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 802/1641] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:25.489328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e931-6294-4c64-b3ac-215495cbfebf None None] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:25.489856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e931-6294-4c64-b3ac-215495cbfebf None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:25.490008 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47e931-6294-4c64-b3ac-215495cbfebf None None] PATH_INFO: `/` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:25.491449 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 840/1642] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:25.501676 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce15f-40b1-41d3-a5fc-2ccf7c487da6 None None] REQUEST_METHOD: `POST` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:25.502134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce15f-40b1-41d3-a5fc-2ccf7c487da6 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:25.502239 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ce15f-40b1-41d3-a5fc-2ccf7c487da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:25.521879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.auth.core [None req-767ce15f-40b1-41d3-a5fc-2ccf7c487da6 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:25.523103 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-767ce15f-40b1-41d3-a5fc-2ccf7c487da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:25.531729 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 803/1643] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:58:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:25.545854 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e931-6294-4c64-b3ac-215495cbfebf None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:25.562693 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47e931-6294-4c64-b3ac-215495cbfebf None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:25.572588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:25.573184 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:25.573463 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:25.573757 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:25.584110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:25.585928 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448d7a4-8944-48a4-b6b3-8be7f32876db service placement] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:25.602420 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 841/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:28.718837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074cd62-99fc-435a-9857-07629463c147 None None] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:28.719321 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074cd62-99fc-435a-9857-07629463c147 None None] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:28.719438 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074cd62-99fc-435a-9857-07629463c147 None None] PATH_INFO: `/` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:28.720829 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 804/1645] 10.222.0.59 () {54 vars in 921 bytes} [Mon Jul 25 22:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 22:58:28.730680 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:28.731144 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:28.731279 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:28.750778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] MFA Rules not processed for user `dcb9edc853614b11b608904ee161a42e`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:58:28.752202 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:28.761075 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 842/1646] 10.222.0.59 () {58 vars in 1018 bytes} [Mon Jul 25 22:58:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:58:28.781033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074cd62-99fc-435a-9857-07629463c147 None None] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:28.796520 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074cd62-99fc-435a-9857-07629463c147 None None] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:28.796652 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:28.802134 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:28.802839 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:28.803197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:28.804129 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:28.808932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3764-cfe3-4660-a73e-12730cee6731 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:28.814328 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:28.814711 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:28.815358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:28.815914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:28.816242 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] PATH_INFO: `/v3/users/1f77b6499dde4cc78fc4d4b5ab43dc47` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:28.816977 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:28.817714 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f77b6499dde4cc78fc4d4b5ab43dc47)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:28.818861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: WARNING py.warnings [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:58:28.818861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: warnings.warn(msg) Jul 25 22:58:28.818861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: Jul 25 22:58:28.820042 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:28.828124 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 805/1647] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:58:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:58:28.888825 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f77b6499dde4cc78fc4d4b5ab43dc47'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:28.889411 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f77b6499dde4cc78fc4d4b5ab43dc47'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:28.890040 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f77b6499dde4cc78fc4d4b5ab43dc47'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:28.900115 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f77b6499dde4cc78fc4d4b5ab43dc47'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:28.917958 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f77b6499dde4cc78fc4d4b5ab43dc47'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:28.930035 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 843/1648] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Jul 25 22:58:28 2022] DELETE /identity/v3/users/1f77b6499dde4cc78fc4d4b5ab43dc47 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:58:29.111373 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:29.125052 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8c0c-9899-4b40-8595-1e9cd2171ce6 service placement] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:29.182572 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:29.183209 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:29.183488 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:29.183756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] PATH_INFO: `/v3/projects/6df2ab7798674d6e9031bac10f0e7f77` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:29.185536 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6df2ab7798674d6e9031bac10f0e7f77)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:29.186547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: WARNING py.warnings [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:58:29.186547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: warnings.warn(msg) Jul 25 22:58:29.186547 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: Jul 25 22:58:29.187753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:29.240955 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6df2ab7798674d6e9031bac10f0e7f77', 'request_id': 'req-a9f941ef-a49c-41cc-8208-b44b209c1065'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.248934 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6df2ab7798674d6e9031bac10f0e7f77', 'request_id': 'req-a9f941ef-a49c-41cc-8208-b44b209c1065'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.250174 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:29.256571 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6df2ab7798674d6e9031bac10f0e7f77', 'request_id': 'req-a9f941ef-a49c-41cc-8208-b44b209c1065'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.274778 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] The token cache is being invalidate because project 6df2ab7798674d6e9031bac10f0e7f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:58:29.275065 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.275728 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.277492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 806/1649] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Jul 25 22:58:29 2022] DELETE /identity/v3/projects/6df2ab7798674d6e9031bac10f0e7f77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 22:58:29.281382 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:29.282792 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:29.296197 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e12da3-2f6c-402b-9ecc-affbb9635b5f admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:29.351444 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:29.352085 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:29.352400 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:29.352677 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] PATH_INFO: `/v3/users/27fa8761e2a34defa1ffb1f4371fada8` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:29.353814 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fa8761e2a34defa1ffb1f4371fada8)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:29.355749 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:29.383662 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:29.402777 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fa8761e2a34defa1ffb1f4371fada8'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.403374 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fa8761e2a34defa1ffb1f4371fada8'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.403991 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fa8761e2a34defa1ffb1f4371fada8'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.410953 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fa8761e2a34defa1ffb1f4371fada8'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.423453 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-f10cfe79-681f-4a9e-ad3b-ff774d124c4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fa8761e2a34defa1ffb1f4371fada8'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.436372 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 844/1650] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Jul 25 22:58:29 2022] DELETE /identity/v3/users/27fa8761e2a34defa1ffb1f4371fada8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:58:29.608886 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:58:29.610619 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:58:29.623358 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f941ef-a49c-41cc-8208-b44b209c1065 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:58:29.681742 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:58:29.682313 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:58:29.682596 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:58:29.682875 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] PATH_INFO: `/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:58:29.684020 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dbd37d6bba483a9c9cfc8c11231a8e)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:58:29.686010 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:58:29.733700 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dbd37d6bba483a9c9cfc8c11231a8e', 'request_id': 'req-2fc4d5d2-02a5-42df-98db-f6fddf00af27'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.740694 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dbd37d6bba483a9c9cfc8c11231a8e', 'request_id': 'req-2fc4d5d2-02a5-42df-98db-f6fddf00af27'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.746404 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dbd37d6bba483a9c9cfc8c11231a8e', 'request_id': 'req-2fc4d5d2-02a5-42df-98db-f6fddf00af27'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.757301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] The token cache is being invalidate because project 66dbd37d6bba483a9c9cfc8c11231a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 22:58:29.757584 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.758205 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 22:58:29.759772 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 807/1651] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Jul 25 22:58:29 2022] DELETE /identity/v3/projects/66dbd37d6bba483a9c9cfc8c11231a8e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 22:58:39.432481 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:39.754265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=1 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:18.343850 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] REQUEST_METHOD: `POST` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:18.344385 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:18.344495 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:18.363887 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.auth.core [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] MFA Rules not processed for user `9911e8bb7a254ec7b0fe19d36ebd9b98`. Rule list: `[]` (Enabled: `True`). {{(pid=87030) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 22:59:18.365127 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:18.419555 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 845/1652] 10.222.0.59 () {58 vars in 958 bytes} [Mon Jul 25 22:59:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 22:59:20.164856 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:20.166319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:20.243756 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d5d2-02a5-42df-98db-f6fddf00af27 admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:20.248726 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:20.249996 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:20.250278 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:20.250552 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:20.252443 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:20.264159 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:20.265813 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:20.275879 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 808/1653] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:28.412244 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=25 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:30.271598 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=32 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:59:35.463837 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 22:59:35.465337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:35.541207 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a64c31-6dc3-4d49-8766-6874212fc7f0 None None] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 22:59:35.546709 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 22:59:35.547337 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 22:59:35.547624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 22:59:35.547905 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 22:59:35.549712 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 22:59:35.561301 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 22:59:35.563494 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 22:59:35.574181 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 846/1654] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 22:59:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 22:59:45.569915 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=34 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:00:21.653414 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:00:21.710999 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f0fb-7bae-41ff-991c-1ed2e40621eb service placement] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:00:21.716043 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:00:21.716688 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:00:21.716967 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:00:21.717238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:00:21.718978 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:00:21.751376 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:00:21.753154 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:00:21.762468 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 809/1655] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 23:00:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:00:31.758577 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=36 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:16.251153 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:16.334110 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35016a04-524c-4f33-bd94-0891847b3191 service nova] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:16.340224 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0683955d11d0442cae5e9e4d4f973e10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:16.341022 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:16.341342 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:16.341620 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:16.343784 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:16.371539 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:16.373951 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:16.385948 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 847/1656] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:21.709046 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:21.710505 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:21.785084 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2241c82-5e55-4647-a652-db23e3e79623 service placement] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:21.788788 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fc7adc92a5b41bea6a0929eadc50689', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:21.789399 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] REQUEST_METHOD: `GET` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:21.789675 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:21.789943 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:21.791650 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:21.874910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:21.876398 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:21.898302 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 810/1657] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 23:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:01:26.380588 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=35 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:27.789946 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:27.793319 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:27.807512 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22578905-6086-4a45-8345-bed7216cb3a8 service nova] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:27.812558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:27.813238 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:27.813517 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:27.813824 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] PATH_INFO: `/v3/users/9911e8bb7a254ec7b0fe19d36ebd9b98` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:27.815031 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9911e8bb7a254ec7b0fe19d36ebd9b98)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:27.817033 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:27.868563 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9911e8bb7a254ec7b0fe19d36ebd9b98'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:27.869233 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9911e8bb7a254ec7b0fe19d36ebd9b98'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:27.869861 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9911e8bb7a254ec7b0fe19d36ebd9b98'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:27.876957 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9911e8bb7a254ec7b0fe19d36ebd9b98'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:27.892910 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9911e8bb7a254ec7b0fe19d36ebd9b98'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:27.905679 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 848/1658] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:27 2022] DELETE /identity/v3/users/9911e8bb7a254ec7b0fe19d36ebd9b98 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:28.078558 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:28.090707 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b97e15-5d0c-42e8-9509-333efa6f9b3a service neutron] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:28.149367 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:28.149963 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:28.150275 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:28.150553 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] PATH_INFO: `/v3/projects/5e48ea2aa437431caccfb50c71e3bab4` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:28.151718 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e48ea2aa437431caccfb50c71e3bab4)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:28.153699 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:28.155914 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=100 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:28.200549 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e48ea2aa437431caccfb50c71e3bab4', 'request_id': 'req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.210188 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e48ea2aa437431caccfb50c71e3bab4', 'request_id': 'req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.215803 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e48ea2aa437431caccfb50c71e3bab4', 'request_id': 'req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.227607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] The token cache is being invalidate because project 5e48ea2aa437431caccfb50c71e3bab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:28.227897 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.228568 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.230092 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 811/1659] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:28 2022] DELETE /identity/v3/projects/5e48ea2aa437431caccfb50c71e3bab4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:28.234094 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:28.235482 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:28.248624 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda0fc6-fe47-4f8c-a14d-3a32b443350c admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:28.304276 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:28.304936 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:28.305214 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:28.305487 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] PATH_INFO: `/v3/users/6166b1bb11274930bdb0640099611fa9` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:28.306667 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6166b1bb11274930bdb0640099611fa9)` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:28.308607 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:28.361606 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6166b1bb11274930bdb0640099611fa9'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.362249 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6166b1bb11274930bdb0640099611fa9'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.362855 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6166b1bb11274930bdb0640099611fa9'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.369713 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6166b1bb11274930bdb0640099611fa9'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.381883 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.notifications [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6166b1bb11274930bdb0640099611fa9'} {{(pid=87030) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.383492 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:28.397753 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 849/1660] 10.222.0.59 () {58 vars in 1224 bytes} [Mon Jul 25 23:01:28 2022] DELETE /identity/v3/users/6166b1bb11274930bdb0640099611fa9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:28.575165 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Authenticating user token {{(pid=87031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:01:28.576737 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.fernet_utils [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:01:28.591164 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be6ea4-7fa0-4d7e-b965-39c03e5ba62a admin admin] Validating token access rules against request {{(pid=87031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:01:28.648932 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f76f4c331aa04a1a86326998b6795006', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bac6b86a78e2495dac480c2085c0033f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:01:28.649567 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:01:28.649847 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] SCRIPT_NAME: `/identity` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:01:28.650118 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] PATH_INFO: `/v3/projects/42846462b7cb48aa949f28a983359536` {{(pid=87031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:01:28.651265 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=42846462b7cb48aa949f28a983359536)` {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:01:28.653179 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] RBAC: Authorization granted {{(pid=87031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:01:28.698807 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42846462b7cb48aa949f28a983359536', 'request_id': 'req-79587856-4960-4cf3-b6dc-466ca6b33eed'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.705655 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42846462b7cb48aa949f28a983359536', 'request_id': 'req-79587856-4960-4cf3-b6dc-466ca6b33eed'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.711745 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42846462b7cb48aa949f28a983359536', 'request_id': 'req-79587856-4960-4cf3-b6dc-466ca6b33eed'} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.722559 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] The token cache is being invalidate because project 42846462b7cb48aa949f28a983359536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 23:01:28.723012 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.723678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG keystone.notifications [None req-79587856-4960-4cf3-b6dc-466ca6b33eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 23:01:28.725266 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: [pid: 87031|app: 0|req: 812/1661] 10.222.0.59 () {58 vars in 1233 bytes} [Mon Jul 25 23:01:28 2022] DELETE /identity/v3/projects/42846462b7cb48aa949f28a983359536 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 23:01:38.395203 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:38.719656 dv-osbrick-849020-3-iscsi devstack@keystone.service[87031]: DEBUG dbcounter [-] [87031] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:28.634678 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Authenticating user token {{(pid=87030) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 23:05:28.636213 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:28.705899 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f175e3b-9bfd-4d76-8aba-176c942aae1e admin admin] Validating token access rules against request {{(pid=87030) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 23:05:28.764077 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcb9edc853614b11b608904ee161a42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd2daa3b47ff4158970171cb1ee0857e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87030) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 23:05:28.764775 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] REQUEST_METHOD: `GET` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 23:05:28.765061 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] SCRIPT_NAME: `/identity` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 23:05:28.765339 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87030) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 23:05:28.767136 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.fernet_utils [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87030) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 23:05:28.777926 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 23:05:28.780023 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad50ef-9049-458a-91ce-37c32058487d service placement] RBAC: Authorization granted {{(pid=87030) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 23:05:28.789740 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: [pid: 87030|app: 0|req: 850/1662] 10.222.0.59 () {60 vars in 1365 bytes} [Mon Jul 25 23:05:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 23:05:38.785641 dv-osbrick-849020-3-iscsi devstack@keystone.service[87030]: DEBUG dbcounter [-] [87030] Writing DB stats keystone:SELECT=58 {{(pid=87030) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}